-- Logs begin at Mon 2022-07-11 13:33:20 UTC, end at Mon 2022-07-11 14:33:16 UTC. -- Jul 11 14:04:04.456738 dv-cinder-819149-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 11 14:04:04.466110 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 11 14:04:04.468075 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 14:04:04 2022] *** Jul 11 14:04:04.468075 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 14:04:04.468075 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 14:04:04.468075 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: nodename: dv-cinder-819149-10-iscsi Jul 11 14:04:04.468075 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: machine: x86_64 Jul 11 14:04:04.468075 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: clock source: unix Jul 11 14:04:04.468075 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: pcre jit disabled Jul 11 14:04:04.468075 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: detected number of CPU cores: 4 Jul 11 14:04:04.468075 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: current working directory: / Jul 11 14:04:04.468075 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: detected binary path: /usr/bin/uwsgi-core Jul 11 14:04:04.468775 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: your processes number limit is 47680 Jul 11 14:04:04.468775 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: your memory page size is 4096 bytes Jul 11 14:04:04.468775 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: detected max file descriptor number: 2048 Jul 11 14:04:04.468775 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: lock engine: pthread robust mutexes Jul 11 14:04:04.468775 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: thunder lock: enabled Jul 11 14:04:04.468775 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 11 14:04:04.468775 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 14:04:04.515001 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: Python main interpreter initialized at 0x564c042219c0 Jul 11 14:04:04.515001 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: python threads support enabled Jul 11 14:04:04.515001 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: your server socket listen backlog is limited to 100 connections Jul 11 14:04:04.515001 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: your mercy for graceful operations on workers is 90 seconds Jul 11 14:04:04.515420 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 14:04:04.515420 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: *** Operational MODE: preforking *** Jul 11 14:04:04.515693 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: *** uWSGI is running in multiple interpreter mode *** Jul 11 14:04:04.515693 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: spawned uWSGI master process (pid: 103347) Jul 11 14:04:04.515903 dv-cinder-819149-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 11 14:04:04.517297 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: spawned uWSGI worker 1 (pid: 103348, cores: 1) Jul 11 14:04:04.517579 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: spawned uWSGI worker 2 (pid: 103349, cores: 1) Jul 11 14:04:04.517731 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 14:04:05.199037 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 14:04:05.250619 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 14:04:06.344824 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:04:06.344824 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: from cryptography.utils import int_from_bytes Jul 11 14:04:06.345473 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:04:06.345473 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: from cryptography.utils import int_from_bytes Jul 11 14:04:06.367723 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:04:06.367723 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: from cryptography.utils import int_from_bytes Jul 11 14:04:06.368252 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:04:06.368252 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: from cryptography.utils import int_from_bytes Jul 11 14:04:08.871506 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 14:04:08.872094 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 14:04:08.872299 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 14:04:08.872655 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 14:04:08.872933 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 14:04:08.873338 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.873661 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.874007 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.874411 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.874761 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.875073 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.875396 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.875746 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.876116 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.876354 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.876691 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.877012 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-10-iscsi {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.877333 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.877643 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.877957 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.878308 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.878666 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.878965 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.879275 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.879781 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.880210 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.880525 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.880851 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.881069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 14:04:08.881564 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.881654 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 14:04:08.881743 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.881825 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 14:04:08.881905 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.882135 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.882259 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 14:04:08.882434 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 14:04:08.882540 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.882778 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.882888 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.883105 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.883241 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.883443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.883535 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-10-iscsi {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.883765 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.883900 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.884094 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.884189 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.884408 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.884515 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.884733 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.884878 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.885057 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.886019 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.886252 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.886406 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.886576 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.886666 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.886735 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.886813 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.887019 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.887117 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-10-iscsi {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.887361 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.887456 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.887669 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.887758 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.887984 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.888074 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.888334 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.888433 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.888619 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.888715 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.888924 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.889013 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.889234 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.889330 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.889553 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.889746 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.889880 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.890061 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.890229 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.890404 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.890504 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.890717 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.890810 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.891057 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.891154 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.891373 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.891753 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.891938 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.892040 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.892251 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.892382 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.892521 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.892611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.892840 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.892932 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.893207 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.893350 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.893492 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.893582 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-10-iscsi {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.893802 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.893900 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.894109 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.894219 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.894450 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.894546 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.894768 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.894888 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.895096 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.895211 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.895420 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.895523 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.895744 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.895835 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.896085 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.896190 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.896400 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.896539 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.896727 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.896829 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.897054 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.897156 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.897371 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.897459 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.897714 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.897808 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.897995 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.898117 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.898331 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.898433 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.898644 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.898769 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.898964 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.899086 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.899274 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.899417 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.899580 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.899670 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.899864 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.900001 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.900137 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.900314 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.900460 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.900649 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.900782 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.901696 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.901887 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.902044 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.902136 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.902380 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.902470 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.902697 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.902806 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.902952 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.903041 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.903258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.903347 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.903565 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.903663 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.903884 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.903972 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.904190 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.904286 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.904496 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.904594 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.904805 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.904895 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.905103 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.905198 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.905419 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.905508 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.905723 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.905818 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.906029 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.906186 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.906362 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.906453 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.906668 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.906756 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.906973 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.907060 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.907281 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.907378 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.907587 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.907676 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.907890 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.907987 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.908210 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.908309 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.908527 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.908625 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.908834 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.908936 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.909137 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.909226 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.909440 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.909538 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.909746 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.909843 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.910051 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.910138 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.910385 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.910474 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.910688 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.910792 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.911009 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.911099 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.911312 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.911410 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.911564 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.911661 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.911868 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.911956 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.912176 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.912264 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.912496 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.912592 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.912806 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.912894 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.913103 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.913197 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.913407 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.913497 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.913707 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.913793 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.914012 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.914100 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.914341 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.914437 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.914639 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.914733 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.914943 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.915030 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.915243 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.915331 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.915545 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.915695 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.915846 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.915946 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.916150 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.916283 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.916548 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.916646 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.916768 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.916903 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.917074 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.917293 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.917394 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.917487 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.917657 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.917754 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.917959 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.918049 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.918323 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.918420 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.918662 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.918752 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.918970 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.919060 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.919280 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.919369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.919604 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.919708 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.919913 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.920002 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.920222 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.920369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.920540 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.920691 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.920850 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.920989 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.921160 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.921298 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.921481 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.921633 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.921776 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.921925 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.922069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.922233 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.922406 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.922546 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.922715 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.922854 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.923023 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.923160 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.923328 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.923464 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.923633 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.923781 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.923931 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.924067 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.924232 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.924323 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.924536 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.924632 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.924841 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.924930 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.925144 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.925234 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.925463 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.925558 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.925774 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.925875 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.926088 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.926247 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.926418 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.926506 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.926714 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.926812 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.927034 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:04:08.927128 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.927375 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.927485 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.927717 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.927814 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.928053 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.928144 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.928365 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.928455 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.928686 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.928790 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.929023 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.929110 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.929334 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.929421 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.929651 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.929752 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.929960 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.930047 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.930297 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.930402 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.930610 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.930709 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.930920 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.931009 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.931233 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.931327 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.931559 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.931649 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.931871 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.931966 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.932244 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.932458 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.932556 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.932632 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.932917 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.933008 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.933229 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.933318 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.933543 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.933646 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.933855 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.933944 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.934186 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.934279 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.934501 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.934600 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.934820 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.934914 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.935132 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.935221 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.935438 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.935528 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.935760 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.935856 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.936088 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.936185 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.936394 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.936492 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.936725 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.936814 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.937033 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.937144 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.937342 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.937432 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.937650 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.937739 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.937959 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.938057 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.938291 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.938384 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.938603 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.938694 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.938912 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.939010 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.939217 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.939307 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.939528 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.939615 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.939834 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.939996 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.940137 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.940275 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.940432 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.940571 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.940736 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.940872 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.941039 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.941132 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.941353 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.941488 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.941664 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.941800 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.941972 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.942109 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.942305 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.942440 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.942616 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.942751 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.942920 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.943055 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.943230 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.943375 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.943538 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.943674 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.943853 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.943997 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.944162 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.944309 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.944480 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.944613 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.944806 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.944939 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.945116 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.945261 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.945430 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.945572 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.945734 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.945882 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.946028 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.946204 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.946354 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.946499 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.946655 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.946790 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.946962 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.947061 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.947271 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.947406 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.947574 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.948243 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.948443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.948535 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.948801 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.948939 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.949106 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.949241 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.949413 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.949554 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.949736 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.949891 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.950047 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.950237 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.950447 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.950595 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.950756 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.950894 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.951060 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.951211 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.951399 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.951532 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.951704 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.951843 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.952016 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.952162 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.952343 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.952490 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.952662 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.952802 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.952979 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.953128 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.953287 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.953431 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.953603 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.953750 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.953913 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.954062 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.954248 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.954387 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.954544 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.954683 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.954857 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.955005 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.955183 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.955329 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.955494 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.955638 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.955786 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.955928 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.956097 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.956249 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.956407 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.956556 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.956706 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.956792 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.957011 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.957111 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.957311 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.957400 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.957615 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.957705 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.957922 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.958012 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.958260 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.958366 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.958586 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.958673 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.958897 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.958993 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.959205 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.959307 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.959509 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.959604 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.959815 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.959905 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.960124 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.960223 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.960433 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.960523 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.960744 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.960833 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.961064 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.961162 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.961374 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.961463 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.961691 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.961783 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.962004 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.962108 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.962354 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.962444 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.962666 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.962754 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.962981 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.963080 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.963283 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.963412 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.964174 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.964382 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.964531 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.964800 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.964934 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.965125 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.965268 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.965440 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.965585 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.965768 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.965905 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.966086 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.966286 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.966427 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.966575 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.966734 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.966869 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.967054 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.967208 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.967363 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.967499 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.967657 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.967797 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.967971 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.968110 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.968287 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.968428 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.968599 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.968738 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.968909 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.969054 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.969204 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.969352 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.969518 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.969659 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.969828 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.969965 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.970125 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.970294 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.970458 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.970597 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.970769 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.970870 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.971093 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.971191 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.971402 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.971492 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.971726 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.971827 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.972051 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.972151 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.972370 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.972477 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.972669 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.972767 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.972987 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.973076 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.973294 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.973389 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.973601 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.973699 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.973907 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.974004 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.974236 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.974349 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.974578 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.974684 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.974887 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.974976 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.975197 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.975294 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.975511 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.975652 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.975821 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.975961 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.976129 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.976267 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.976442 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.976587 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.976751 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.976887 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.977063 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.977154 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.977373 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.977469 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.977683 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.977776 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.977990 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.978078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.978327 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.978432 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.978636 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.978731 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.978966 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.979067 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.979286 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.979416 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.979669 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.979758 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.980030 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.980131 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.980338 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.980436 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.980649 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.980738 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.980953 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.981050 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.981260 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.981348 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.981576 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.981663 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.981887 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.982150 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.982261 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.982511 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.982600 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.982816 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.982966 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.983136 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.983274 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.983457 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.983611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.983829 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.983979 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.984117 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.984402 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.984537 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.984758 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.985195 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.985549 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.985731 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.985819 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.985901 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.985980 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.986059 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.986137 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.986258 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.986353 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.987696 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.987801 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.987888 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.987979 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.988070 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.988152 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.988231 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.988309 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.988387 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.988479 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.988560 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.988638 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.988721 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.988800 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.988878 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.988965 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.989045 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.989123 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.989201 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.989315 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.989491 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.989656 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.989811 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.989950 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.990088 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.990274 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.990422 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.990576 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.990713 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.990971 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.991117 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.991307 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.991456 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.991626 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.991765 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.991922 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.992059 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.992258 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.992411 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.992581 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.992720 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.992916 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.993054 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.993221 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.993367 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.993518 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.993656 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.993821 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.993967 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.994128 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.994292 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.994441 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.994605 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.994856 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.994990 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.995182 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.995313 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.995501 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.995659 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.995811 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.995965 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.996103 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.996239 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.996405 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.996547 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.996736 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.996888 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.997053 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.997234 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.997373 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.997508 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.997652 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.997809 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.997954 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.998049 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.998272 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.998376 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.998584 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.998681 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.998888 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.998985 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.999189 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.999278 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.999500 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.999628 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.999819 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:08.999958 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.000106 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.000194 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.000412 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.000499 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.000713 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.000802 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.001028 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.001116 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.001332 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.001428 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.001636 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.001726 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.001940 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.002029 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.002274 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.002376 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.002586 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.002676 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.002891 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.002981 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.003215 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.003318 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.003523 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.003620 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.003827 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.003916 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.004131 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.004229 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.004441 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.004528 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.004741 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.004828 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.005051 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.005185 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.005357 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.005447 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.005671 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.005759 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.005984 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.006081 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.006311 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.006398 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.006621 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.006715 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.006997 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.007109 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.007229 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.007323 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.007533 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.007621 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.007841 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.007944 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.008148 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.008246 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.008448 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.008534 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.008752 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.008840 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.009054 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.009141 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.009355 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.009448 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.009662 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.009821 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.009966 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.010102 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.011054 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.011201 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.011355 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.011520 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.011665 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.011799 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.011935 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.012155 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.012296 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.012459 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.012629 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.012770 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.012905 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.013050 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.013194 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.013335 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.013471 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.013607 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.013744 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.013889 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.014026 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.014186 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.014332 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.014481 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.014619 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.014764 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.014902 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.015071 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.015216 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.015383 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.015533 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.015702 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.015859 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.015995 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.016143 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.016298 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.016700 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.016845 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.016988 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.017149 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.017297 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.017445 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.017596 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.017769 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.017909 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.018090 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.018292 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.018443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.018591 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.018729 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.018866 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.018998 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.019137 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.019321 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.019460 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.019630 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.019770 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.019936 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.020075 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.020242 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.020398 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.020535 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.020671 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.020849 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.020985 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.021160 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.021252 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.021470 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.021576 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.021781 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.021871 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.022091 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.022210 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.022427 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.022517 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.022740 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.022843 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.023047 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.023137 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.023361 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.023450 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.023668 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.023769 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.023974 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.024071 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.024285 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.024374 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.024587 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.024684 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.024897 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.024987 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.025200 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.025289 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.025529 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.025627 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.025932 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.026617 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.026969 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.027073 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.027327 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.027523 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.027644 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.027872 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.028006 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.028207 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.028354 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.028522 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.028650 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.028841 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.028969 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.029161 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.029302 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.029477 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.029604 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.029792 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.029934 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.030098 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.030269 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.030439 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.030565 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.030759 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.030893 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.031066 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.031207 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.031379 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.031506 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.031740 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.031876 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.032056 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.032180 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.032310 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.032432 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.032622 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.032750 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.032935 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.033075 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.033255 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.033429 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.033560 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.033696 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.033863 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.034008 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.034206 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.034354 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.034508 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.034704 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.034869 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.035055 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.035180 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.035392 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.035543 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.035723 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.035861 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.036046 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.036176 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.036387 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.036485 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.036733 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.036835 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.037014 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.037101 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.037325 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.037411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.037649 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.037753 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.037970 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.038059 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.038303 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.038436 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.038660 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.038849 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.039033 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.039216 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.039408 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.039605 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.039810 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.039995 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.040174 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.040364 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.040550 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.040743 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.040933 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.041118 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.041299 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.041503 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.041687 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.041910 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.041910 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.042355 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.042355 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.042702 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.042886 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.043069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.043250 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.043441 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.043633 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.043816 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.044009 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.044200 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.044392 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.044589 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.044771 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.044953 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.045137 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.045318 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.045533 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.045758 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.045944 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.046201 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.046386 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.046568 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.046764 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.046947 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.047077 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.047270 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.047452 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.047637 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.047830 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.048023 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.048228 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.048436 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.048650 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.048861 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.049131 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.049338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.049556 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.049789 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.049997 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.050273 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.050486 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.050697 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.050912 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.051124 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.051328 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.051488 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.051631 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.051766 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.051902 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.052044 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.052190 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.052349 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.052493 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.052641 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.052788 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.052923 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.053087 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.053241 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.053413 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.053555 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.053675 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.053762 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.053854 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.053940 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.054022 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.054103 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.054264 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.054352 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.054482 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.054574 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.054665 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.054750 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.054831 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.054912 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.055006 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.055089 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.055169 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.055257 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.055339 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.055339 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.055497 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.055566 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.055566 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.055766 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.055859 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.055960 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.056044 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.056044 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.056192 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.056272 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.056387 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.056573 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.056710 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.057023 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.057172 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.057466 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.057758 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.057864 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.058144 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.058391 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.058529 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.058837 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.058935 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.059176 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.059497 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.059595 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.059885 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.060080 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.060191 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.060508 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.060655 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.060834 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.061128 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.061282 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.061503 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.061622 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.061764 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.062092 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.062333 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.062558 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.062787 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.062925 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.063069 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.063210 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.063337 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.063544 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.063641 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.063859 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.063982 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.064171 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.064293 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.064489 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.064615 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.064830 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.065063 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.065236 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.065381 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.065684 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.066003 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.066248 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.066344 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.066601 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.066712 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.066904 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.067001 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.067229 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.067327 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.067551 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.067692 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.067865 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.067966 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.068183 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.068274 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.068500 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.068599 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.068811 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.068902 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.069123 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.069220 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.069432 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.069595 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.069762 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.069853 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.070075 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.070216 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.070429 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.070526 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.070746 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.070845 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.071062 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.071159 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.071376 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.071524 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.071699 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.071795 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.072036 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.072127 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.072353 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.072507 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.073392 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.073509 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.073509 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.073726 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.073815 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.073945 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.074132 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.074298 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.074470 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.074582 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.074809 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.074930 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.075124 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.075214 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.075440 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.075544 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.075756 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.075847 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.076074 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.076163 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.076394 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.076485 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.076712 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.076808 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.077029 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.077125 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.077346 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.077476 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.077666 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.077794 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.077988 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.078222 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.078335 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.078540 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.078872 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.079006 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.079197 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.079296 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.079520 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.079616 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.079849 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.079945 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.080155 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.080255 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.080474 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.080564 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.080778 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.080866 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.081083 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.081187 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.081393 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.081483 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.081699 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.081791 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.082009 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.082139 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.082365 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.082471 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.082692 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.082815 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.083015 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.083144 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.083353 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.083472 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.083691 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.083789 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.083981 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.084231 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.084333 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.084582 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.084800 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.084894 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.084986 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.085217 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.085307 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.085542 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.085631 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.085862 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.085957 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.086204 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.086332 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.086527 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.086647 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.086845 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.087007 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.087149 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.087239 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.087466 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.087562 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.087775 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.087865 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.088088 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.088177 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.089031 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.089208 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.089372 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.089464 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.089692 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.089784 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.089997 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.090098 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.090334 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.090427 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.090657 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.090754 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.091000 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.091132 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.091307 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.091397 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.091616 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.091743 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.091936 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.092215 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.092364 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.092502 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.092588 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.092800 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.092938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.093124 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.093223 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.093455 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.093560 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.093777 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.093904 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.094098 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.094227 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.094454 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.094551 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.094762 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.094872 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.095069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.095171 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.095406 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.095504 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.095725 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.095831 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.096017 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.096139 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.096345 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.096467 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.096660 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.096752 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.096971 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.097125 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.097293 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.097430 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.097609 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.097760 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.097956 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.098189 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.098333 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.098537 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.098727 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.098870 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.099009 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.099193 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.099336 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.099565 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.099818 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.099979 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.100158 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.100296 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.100486 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.100709 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.100849 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.100986 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.101124 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.101262 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.101398 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.101549 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.101712 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.101860 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.102022 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.102113 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.102368 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.102474 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.102679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.102769 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.102992 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.103082 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.103300 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.103399 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.103613 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.103703 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.104141 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.104286 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.104286 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.104510 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.104641 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.104728 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.104887 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.104978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.105197 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.105288 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.105505 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.105604 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.105834 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.105916 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.106105 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.106221 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.106438 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.106538 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.106746 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.106850 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.107063 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.107161 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.107370 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.107469 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.107685 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.107786 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.107994 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.108092 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.108308 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.108398 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.108613 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.108715 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.108920 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.109010 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.109228 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.109357 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.109538 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.109641 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.109853 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.109944 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.110203 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.110297 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.110516 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.110606 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.110821 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.110920 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.111145 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.111233 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.111463 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.111555 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.111779 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.111908 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.112134 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.112232 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.112447 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.112538 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.112769 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.112987 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.113085 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.113325 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.113417 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.113650 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.113740 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.113988 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.114080 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.114339 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.114431 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.114649 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.114737 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.114958 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.115052 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.115267 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.115359 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.115594 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.115684 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.115898 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.116051 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.116198 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.116281 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.116505 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.116599 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.116820 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.116918 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.117127 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.117217 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.117434 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.117542 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.117733 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.117837 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.118041 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.118130 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.118367 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.118457 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.118670 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.118773 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.118971 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.119107 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.119273 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.119371 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.120154 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.120258 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.120460 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.120624 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.120766 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.120987 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.121124 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.121318 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.121412 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.121690 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.121787 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.121946 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.122108 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.122293 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.122441 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.122596 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.122742 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.122913 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.123092 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.123219 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.123403 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.123537 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.123680 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.123827 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.123969 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.124155 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.124332 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.124479 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.124590 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.124793 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.124892 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.125110 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.125223 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.125423 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.125539 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.125742 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.125864 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.126058 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.126237 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.126419 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.126583 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.126735 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.126859 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.127009 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.127160 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.127319 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.127471 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.127651 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.127793 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.127981 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.128116 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.128312 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.128493 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.128645 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.128788 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.128925 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.129064 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.129209 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.129360 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.129500 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.129638 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.129822 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.129960 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.130192 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.130332 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.130512 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.130653 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.130828 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.130969 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.131147 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.131243 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.131453 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.131542 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.131761 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.131852 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.132068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.132159 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.132373 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.132471 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.132682 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.132782 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.132989 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.133079 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.133294 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.133382 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.133601 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.133699 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.133905 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.133995 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.134235 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.134333 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.134543 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.134646 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.134850 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.134941 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.135175 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.135815 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.136028 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.136145 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.136356 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.136543 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.136650 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.136741 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.136958 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.137050 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.137265 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.137367 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.137570 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.137669 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.137874 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.137974 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.138234 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.138331 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.138576 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.138668 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.138895 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.138985 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.139141 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 14:04:09.139233 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.139518 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.139841 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.140153 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.140479 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.140805 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.141125 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.141757 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.142096 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.142435 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.142749 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.143064 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.143380 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.143694 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.144010 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.144339 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.144665 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.144983 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.145311 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.145632 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.145954 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.146296 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.146612 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.146944 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.147258 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.147572 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.147893 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.148212 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.148525 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.148843 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.149161 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.149493 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.149821 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.150135 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.150486 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.150987 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.151282 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.151601 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.151952 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.152286 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.152602 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.152918 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.153238 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:04:09.153485 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 14:04:09.201744 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO dbcounter [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] Registered counter for database nova_api Jul 11 14:04:09.216957 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-161738b9-9b63-4278-91c8-9680f13274a5 None None] Registered counter for database nova_api Jul 11 14:04:09.316053 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_db.sqlalchemy.engines [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:04:09.323044 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writer thread running {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:04:09.328592 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-161738b9-9b63-4278-91c8-9680f13274a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:04:09.335090 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:04:09.383959 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.context [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9ce20a7-cf1f-45a0-823d-be4011508976(cell1) {{(pid=103349) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 14:04:09.388298 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:04:09.389986 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:04:09.390877 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:04:09.390982 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.context [None req-161738b9-9b63-4278-91c8-9680f13274a5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9ce20a7-cf1f-45a0-823d-be4011508976(cell1) {{(pid=103348) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 14:04:09.393383 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:04:09.395200 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-161738b9-9b63-4278-91c8-9680f13274a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:04:09.395560 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO dbcounter [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] Registered counter for database nova_cell0 Jul 11 14:04:09.396805 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-161738b9-9b63-4278-91c8-9680f13274a5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:04:09.397614 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-161738b9-9b63-4278-91c8-9680f13274a5 None None] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:04:09.399715 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO dbcounter [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] Registered counter for database nova_cell1 Jul 11 14:04:09.399819 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-161738b9-9b63-4278-91c8-9680f13274a5 None None] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:04:09.402374 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-161738b9-9b63-4278-91c8-9680f13274a5 None None] Registered counter for database nova_cell0 Jul 11 14:04:09.406239 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-161738b9-9b63-4278-91c8-9680f13274a5 None None] Registered counter for database nova_cell1 Jul 11 14:04:09.408196 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_db.sqlalchemy.engines [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:04:09.410189 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_db.sqlalchemy.engines [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:04:09.413750 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-161738b9-9b63-4278-91c8-9680f13274a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:04:09.417085 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writer thread running {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:04:09.417847 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-161738b9-9b63-4278-91c8-9680f13274a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:04:09.419037 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writer thread running {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:04:09.420407 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:04:09.563982 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:04:09.571209 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO dbcounter [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] Registered counter for database nova_cell0 Jul 11 14:04:09.573995 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-161738b9-9b63-4278-91c8-9680f13274a5 None None] Registered counter for database nova_cell0 Jul 11 14:04:09.581110 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_db.sqlalchemy.engines [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:04:09.586516 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writer thread running {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:04:09.586691 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-161738b9-9b63-4278-91c8-9680f13274a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:04:09.591510 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:04:09.930629 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: WARNING keystonemiddleware.auth_token [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 14:04:09.936137 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-161738b9-9b63-4278-91c8-9680f13274a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 14:04:09.938221 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: WARNING keystonemiddleware.auth_token [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 14:04:09.943418 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-161738b9-9b63-4278-91c8-9680f13274a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 14:04:10.285512 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: WARNING keystonemiddleware.auth_token [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 14:04:10.291672 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: WARNING keystonemiddleware.auth_token [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 14:04:10.295517 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-161738b9-9b63-4278-91c8-9680f13274a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 14:04:10.297057 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564c042219c0 pid: 103349 (default app) Jul 11 14:04:10.299175 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:04:10.300396 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001816 Jul 11 14:04:10.300810 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 788 bytes} [Mon Jul 11 14:04:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:04:10.301698 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-161738b9-9b63-4278-91c8-9680f13274a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 14:04:10.307210 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564c042219c0 pid: 103348 (default app) Jul 11 14:05:28.365720 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:05:28.366828 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jul 11 14:05:28.367991 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 2/2] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 11 14:05:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:05:28.379830 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=3 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:28.380716 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell0:SELECT=3 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:28.381533 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell1:SELECT=3 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:28.382774 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:29.295454 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-737f6d9a-1c51-4642-b62b-3a2bee812a01 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:05:29.329894 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-737f6d9a-1c51-4642-b62b-3a2bee812a01 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.955265 Jul 11 14:05:29.330894 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 1/3] 10.222.0.66 () {60 vars in 1291 bytes} [Mon Jul 11 14:05:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:05:31.619855 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:05:31.622393 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-a5b4390d-0e9c-4735-878d-e27cc8978493 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002766 Jul 11 14:05:31.622770 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 3/4] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 11 14:05:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:05:32.131476 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-e110a421-1534-4d58-b980-eb809cc7a2ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:05:32.152349 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:05:32.152349 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Jul 11 14:05:32.181933 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-e110a421-1534-4d58-b980-eb809cc7a2ea admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.552992 Jul 11 14:05:32.189699 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 2/5] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 11 14:05:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:05:32.412521 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-8e278a16-6211-4b09-953b-b145132aec1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:05:32.415818 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:05:32.415818 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: warnings.warn(msg) Jul 11 14:05:32.418521 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_api:SELECT=3 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:32.419442 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_cell0:SELECT=3 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:32.420010 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_cell1:SELECT=3 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:32.420714 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:32.481201 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-8e278a16-6211-4b09-953b-b145132aec1e admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290122 Jul 11 14:05:32.494649 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 4/6] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Jul 11 14:05:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:05:34.814441 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-e110a421-1534-4d58-b980-eb809cc7a2ea admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:05:34.815366 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-e110a421-1534-4d58-b980-eb809cc7a2ea admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jul 11 14:05:34.816017 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 3/7] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 11 14:05:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:05:35.508366 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-db675ea8-5051-437f-bb96-61502b76dbc1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "name": "ds512M", "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:05:35.526738 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:05:35.526738 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: warnings.warn(msg) Jul 11 14:05:35.548507 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-db675ea8-5051-437f-bb96-61502b76dbc1 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.725002 Jul 11 14:05:35.549228 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 5/8] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 11 14:05:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:05:35.561820 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-bd98f3b4-afdb-46c0-a73d-55d93b73eb6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:05:35.563400 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:05:35.563400 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Jul 11 14:05:35.599077 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-bd98f3b4-afdb-46c0-a73d-55d93b73eb6a admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041154 Jul 11 14:05:35.600247 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 4/9] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Jul 11 14:05:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:05:37.995377 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-db675ea8-5051-437f-bb96-61502b76dbc1 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:05:37.996637 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-db675ea8-5051-437f-bb96-61502b76dbc1 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 11 14:05:38.006256 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 6/10] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 11 14:05:37 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:05:38.368646 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-b0bc695d-e69e-4767-b22c-9d9f50515d2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "name": "ds1G", "id": "d2"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:05:38.389046 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-b0bc695d-e69e-4767-b22c-9d9f50515d2d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.386625 Jul 11 14:05:38.389856 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 5/11] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 11 14:05:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:05:38.402513 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-61f3f803-4b61-4fe4-86c0-f210024953fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:05:38.424575 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-61f3f803-4b61-4fe4-86c0-f210024953fb admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026666 Jul 11 14:05:38.425154 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 7/12] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Jul 11 14:05:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:05:40.747811 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-b0bc695d-e69e-4767-b22c-9d9f50515d2d admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:05:40.748986 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-b0bc695d-e69e-4767-b22c-9d9f50515d2d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001767 Jul 11 14:05:40.749460 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 6/13] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 11 14:05:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:05:41.272204 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-70a2d60a-88aa-433f-9dec-672c4e9e8dd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "name": "ds2G", "swap": 0}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:05:41.293632 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-70a2d60a-88aa-433f-9dec-672c4e9e8dd9 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.536718 Jul 11 14:05:41.294307 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 8/14] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 11 14:05:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:05:41.307260 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-f4a787a6-0852-477e-b50e-973e4f72ca5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:05:41.331107 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-f4a787a6-0852-477e-b50e-973e4f72ca5c admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028253 Jul 11 14:05:41.331697 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 7/15] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Jul 11 14:05:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:05:43.628121 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-70a2d60a-88aa-433f-9dec-672c4e9e8dd9 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:05:43.629282 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-70a2d60a-88aa-433f-9dec-672c4e9e8dd9 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Jul 11 14:05:43.629781 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 9/16] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 11 14:05:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:05:44.093060 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-6b9d0c9b-4ed7-4a57-8981-3a2c3dd928c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "id": "d4", "vcpus": 4, "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:05:44.112396 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-6b9d0c9b-4ed7-4a57-8981-3a2c3dd928c6 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.476365 Jul 11 14:05:44.112963 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 8/17] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 11 14:05:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 14:05:44.125958 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-39f5a5ff-a910-4504-aa8e-16d67f712a6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:05:44.150984 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-39f5a5ff-a910-4504-aa8e-16d67f712a6b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029020 Jul 11 14:05:44.151573 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 10/18] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Jul 11 14:05:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:05:46.660261 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-6b9d0c9b-4ed7-4a57-8981-3a2c3dd928c6 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:05:46.661846 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-6b9d0c9b-4ed7-4a57-8981-3a2c3dd928c6 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002263 Jul 11 14:05:46.662497 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 9/19] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 11 14:05:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:05:47.121293 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-8d7f8a68-7df8-4f59-9e02-51b7484f8203 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:05:47.145303 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-8d7f8a68-7df8-4f59-9e02-51b7484f8203 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.472683 Jul 11 14:05:47.145842 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 11/20] 10.222.0.66 () {60 vars in 1291 bytes} [Mon Jul 11 14:05:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:05:49.567023 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-6b9d0c9b-4ed7-4a57-8981-3a2c3dd928c6 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:05:49.568037 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-6b9d0c9b-4ed7-4a57-8981-3a2c3dd928c6 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jul 11 14:05:49.568434 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 10/21] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 11 14:05:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:05:50.036512 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0c371969-13aa-463b-9e84-93c7a6a4d098 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "name": "m1.tiny", "vcpus": 1, "ram": 512, "id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:05:50.066488 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-0c371969-13aa-463b-9e84-93c7a6a4d098 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.491111 Jul 11 14:05:50.066981 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 12/22] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 11 14:05:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:05:50.079869 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-fe3af7d6-890c-4a70-a393-8965ccca03d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:05:50.104898 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-fe3af7d6-890c-4a70-a393-8965ccca03d2 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028763 Jul 11 14:05:50.105748 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 11/23] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Jul 11 14:05:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:05:52.340644 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0c371969-13aa-463b-9e84-93c7a6a4d098 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:05:52.341704 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-0c371969-13aa-463b-9e84-93c7a6a4d098 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jul 11 14:05:52.342327 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 13/24] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 11 14:05:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:05:52.745782 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-ee48ce7d-eea2-4cff-a923-a4d9d04244f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "2", "os-flavor-access:is_public": true}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:05:52.766293 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-ee48ce7d-eea2-4cff-a923-a4d9d04244f7 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.418243 Jul 11 14:05:52.766967 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 12/25] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 11 14:05:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 14:05:52.779009 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-8c7efa65-90dd-47b5-b30e-b0b16b280b3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:05:52.801629 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-8c7efa65-90dd-47b5-b30e-b0b16b280b3b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026258 Jul 11 14:05:52.802461 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 14/26] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Jul 11 14:05:52 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:05:55.062310 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-ee48ce7d-eea2-4cff-a923-a4d9d04244f7 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:05:55.063511 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-ee48ce7d-eea2-4cff-a923-a4d9d04244f7 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001692 Jul 11 14:05:55.064014 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 13/27] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 11 14:05:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:05:55.495927 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-95106634-3af3-41cb-9854-b833da9f40d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40, "vcpus": 2, "id": "3", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:05:55.514747 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-95106634-3af3-41cb-9854-b833da9f40d6 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.444250 Jul 11 14:05:55.515306 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 15/28] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 11 14:05:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:05:55.527445 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-c80b45c8-992b-4f93-9cbf-90bd6d2c7eef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:05:55.550015 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-c80b45c8-992b-4f93-9cbf-90bd6d2c7eef admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026180 Jul 11 14:05:55.550653 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 14/29] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Jul 11 14:05:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:05:57.860647 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-95106634-3af3-41cb-9854-b833da9f40d6 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:05:57.862303 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-95106634-3af3-41cb-9854-b833da9f40d6 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002060 Jul 11 14:05:57.862882 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 16/30] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 11 14:05:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:05:58.338605 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-14153f44-6351-4c14-a32b-d24f4fe05019 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:05:58.361934 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-14153f44-6351-4c14-a32b-d24f4fe05019 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.492489 Jul 11 14:05:58.362906 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 15/31] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 11 14:05:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:05:58.375411 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-effe9ec6-9593-4a4b-b626-d928ba9a2dad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:05:58.399642 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-effe9ec6-9593-4a4b-b626-d928ba9a2dad admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027945 Jul 11 14:05:58.400418 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 17/32] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Jul 11 14:05:58 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:06:00.723337 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-14153f44-6351-4c14-a32b-d24f4fe05019 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:00.724482 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-14153f44-6351-4c14-a32b-d24f4fe05019 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 11 14:06:00.725505 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 16/33] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 11 14:06:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:01.200941 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-760e0e83-44ca-4394-82da-35e5fc2fdacc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "disk": 160}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:06:01.220824 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-760e0e83-44ca-4394-82da-35e5fc2fdacc admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.488795 Jul 11 14:06:01.221599 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 18/34] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 11 14:06:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:06:01.238567 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-a7104e95-0a23-4e4f-8473-d0a503466c6f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:06:01.242748 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:01.276349 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-a7104e95-0a23-4e4f-8473-d0a503466c6f admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041639 Jul 11 14:06:01.278119 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 17/35] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Jul 11 14:06:01 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:06:21.967652 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-760e0e83-44ca-4394-82da-35e5fc2fdacc admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:21.968714 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-760e0e83-44ca-4394-82da-35e5fc2fdacc admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 11 14:06:21.969112 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 19/36] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 11 14:06:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:22.362816 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-65df45da-b640-41be-b05a-67d59e13f6b8 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:22.380153 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-65df45da-b640-41be-b05a-67d59e13f6b8 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404899 Jul 11 14:06:22.380796 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 18/37] 10.222.0.66 () {60 vars in 1291 bytes} [Mon Jul 11 14:06:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:06:23.463968 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-760e0e83-44ca-4394-82da-35e5fc2fdacc admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:23.465055 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-760e0e83-44ca-4394-82da-35e5fc2fdacc admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 11 14:06:23.465376 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 20/38] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 11 14:06:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:23.992417 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-f3c7c1da-34a0-488a-9be4-557c03d0fa87 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:23.998121 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.wsgi [None req-f3c7c1da-34a0-488a-9be4-557c03d0fa87 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-f3c7c1da-34a0-488a-9be4-557c03d0fa87 admin admin] Request method failure captured: Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Accept: application/json Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Accept-Encoding: gzip, deflate Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Connection: keep-alive Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Content-Length: 0 Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Host: 10.222.0.66 Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Openstack-Api-Version: compute 2.90 Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Openstack-System-Scope: None Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: User-Agent: python-novaclient Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Auth-Token: gAAAAABizC5fGt9mvvlMPftbRbB7trxq7HSw5V24lyBEBNx1xRCVkviE5HqqsGj-zPUS5WkC54TUGKknPq8u3iLmdAChz5q6jSkQqOtQpAjWQxyLH87ka5-W5HOaAdjIkfByXjyjZ8Fge_mAbuRSCxydZLsS-S1VpEq9GPYKYzteC_Fzvrtnq0A Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Domain-Id: None Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Domain-Name: None Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Identity-Status: Confirmed Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Is-Admin-Project: True Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Project-Domain-Id: default Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Project-Domain-Name: Default Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Project-Id: 53f35d51b66c4aec847015cb4a904c77 Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Project-Name: admin Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Role: admin,reader,member Jul 11 14:06:24.001443 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Roles: admin,reader,member Jul 11 14:06:24.003187 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:06:24.003187 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Tenant: admin Jul 11 14:06:24.003187 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Tenant-Id: 53f35d51b66c4aec847015cb4a904c77 Jul 11 14:06:24.003187 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Tenant-Name: admin Jul 11 14:06:24.003187 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-User: admin Jul 11 14:06:24.003187 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-User-Domain-Id: default Jul 11 14:06:24.003187 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-User-Domain-Name: Default Jul 11 14:06:24.003187 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-User-Id: 477dddd95e9e4c9dab1e4c703d6c3e08 Jul 11 14:06:24.003187 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-User-Name: admin Jul 11 14:06:24.003187 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: method: > Jul 11 14:06:24.003187 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: exception: Flavor 42 could not be found. Jul 11 14:06:24.003187 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: action_args: {'id': '42'} Jul 11 14:06:24.003187 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:06:24.003187 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:06:24.004078 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:06:24.005338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:06:24.005338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:06:24.005338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:06:24.005338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:06:24.005338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 14:06:24.005338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:06:24.005338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 11 14:06:24.005338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 11 14:06:24.005338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:06:24.005338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 11 14:06:24.005338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:06:24.005338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:06:24.005338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:06:24.005338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:06:24.005338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:06:24.005338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 11 14:06:24.005338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 11 14:06:24.005338 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-f3c7c1da-34a0-488a-9be4-557c03d0fa87 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:06:24.006700 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-f3c7c1da-34a0-488a-9be4-557c03d0fa87 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.397913 Jul 11 14:06:24.006700 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 19/39] 10.222.0.66 () {60 vars in 1190 bytes} [Mon Jul 11 14:06:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:24.012732 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-474d0cb8-9b35-406c-9645-d6dfb7c902ec admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:24.015833 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:24.034609 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-474d0cb8-9b35-406c-9645-d6dfb7c902ec admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025328 Jul 11 14:06:24.035153 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 21/40] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Jul 11 14:06:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:06:24.045623 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-d10353f9-c449-4adf-be79-171ac1c9cb09 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:24.068113 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-d10353f9-c449-4adf-be79-171ac1c9cb09 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026075 Jul 11 14:06:24.068680 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 20/41] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Jul 11 14:06:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:06:24.078884 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-a3c67af1-fe51-4835-b6a2-7a820709f5a4 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:24.085933 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.wsgi [None req-a3c67af1-fe51-4835-b6a2-7a820709f5a4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-a3c67af1-fe51-4835-b6a2-7a820709f5a4 admin admin] Request method failure captured: Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Accept: application/json Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Accept-Encoding: gzip, deflate Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Connection: keep-alive Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Content-Length: 0 Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Host: 10.222.0.66 Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Openstack-Api-Version: compute 2.90 Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Openstack-System-Scope: None Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: User-Agent: python-novaclient Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Auth-Token: gAAAAABizC5fGt9mvvlMPftbRbB7trxq7HSw5V24lyBEBNx1xRCVkviE5HqqsGj-zPUS5WkC54TUGKknPq8u3iLmdAChz5q6jSkQqOtQpAjWQxyLH87ka5-W5HOaAdjIkfByXjyjZ8Fge_mAbuRSCxydZLsS-S1VpEq9GPYKYzteC_Fzvrtnq0A Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Domain-Id: None Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Domain-Name: None Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Identity-Status: Confirmed Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Is-Admin-Project: True Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Project-Domain-Id: default Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Project-Domain-Name: Default Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Project-Id: 53f35d51b66c4aec847015cb4a904c77 Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Project-Name: admin Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Role: admin,reader,member Jul 11 14:06:24.089369 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Roles: admin,reader,member Jul 11 14:06:24.091059 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:06:24.091059 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Tenant: admin Jul 11 14:06:24.091059 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Tenant-Id: 53f35d51b66c4aec847015cb4a904c77 Jul 11 14:06:24.091059 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Tenant-Name: admin Jul 11 14:06:24.091059 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-User: admin Jul 11 14:06:24.091059 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-User-Domain-Id: default Jul 11 14:06:24.091059 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-User-Domain-Name: Default Jul 11 14:06:24.091059 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-User-Id: 477dddd95e9e4c9dab1e4c703d6c3e08 Jul 11 14:06:24.091059 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-User-Name: admin Jul 11 14:06:24.091059 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: method: > Jul 11 14:06:24.091059 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: exception: Flavor 42 could not be found. Jul 11 14:06:24.091059 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: action_args: {'id': '42'} Jul 11 14:06:24.091059 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:06:24.091059 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:06:24.091964 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:06:24.093258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:06:24.093258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:06:24.093258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:06:24.093258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:06:24.093258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 14:06:24.093258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:06:24.093258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 11 14:06:24.093258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jul 11 14:06:24.093258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:06:24.093258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jul 11 14:06:24.093258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:06:24.093258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:06:24.093258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:06:24.093258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:06:24.093258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:06:24.093258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 11 14:06:24.093258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jul 11 14:06:24.093258 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-a3c67af1-fe51-4835-b6a2-7a820709f5a4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:06:24.094543 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-a3c67af1-fe51-4835-b6a2-7a820709f5a4 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016257 Jul 11 14:06:24.094543 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 22/42] 10.222.0.66 () {60 vars in 1190 bytes} [Mon Jul 11 14:06:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:25.062795 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-d10353f9-c449-4adf-be79-171ac1c9cb09 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:25.063823 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-d10353f9-c449-4adf-be79-171ac1c9cb09 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 11 14:06:25.064221 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 21/43] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 11 14:06:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:25.610046 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-c5c224e9-bb83-415d-8b10-ad30476a0cb0 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:25.617959 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.wsgi [None req-c5c224e9-bb83-415d-8b10-ad30476a0cb0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-c5c224e9-bb83-415d-8b10-ad30476a0cb0 admin admin] Request method failure captured: Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Accept: application/json Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Accept-Encoding: gzip, deflate Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Connection: keep-alive Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Content-Length: 0 Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Host: 10.222.0.66 Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Openstack-Api-Version: compute 2.90 Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Openstack-System-Scope: None Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: User-Agent: python-novaclient Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Auth-Token: gAAAAABizC5gag1l4-Y5bSolpd6RoPaBkLu_eIoXNKJUvdEKbVZUdGdSjct4wnXJxlYj22Ds99DeOV2l4qUjOfmJcFpjLAlFImD96xR5OBeiOBuDpYs4KXoI2_ZRU9gmg0vWd8LOx0uR05dV2wsUFLosyWKmsmWcoSYWdAOW2jyzxNmDwnc2j-g Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Domain-Id: None Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Domain-Name: None Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Identity-Status: Confirmed Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Is-Admin-Project: True Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Project-Domain-Id: default Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Project-Domain-Name: Default Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Project-Id: 53f35d51b66c4aec847015cb4a904c77 Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Project-Name: admin Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Role: admin,reader,member Jul 11 14:06:25.619679 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Roles: admin,reader,member Jul 11 14:06:25.621394 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:06:25.621394 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Tenant: admin Jul 11 14:06:25.621394 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Tenant-Id: 53f35d51b66c4aec847015cb4a904c77 Jul 11 14:06:25.621394 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Tenant-Name: admin Jul 11 14:06:25.621394 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-User: admin Jul 11 14:06:25.621394 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-User-Domain-Id: default Jul 11 14:06:25.621394 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-User-Domain-Name: Default Jul 11 14:06:25.621394 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-User-Id: 477dddd95e9e4c9dab1e4c703d6c3e08 Jul 11 14:06:25.621394 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-User-Name: admin Jul 11 14:06:25.621394 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: method: > Jul 11 14:06:25.621394 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: exception: Flavor 84 could not be found. Jul 11 14:06:25.621394 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: action_args: {'id': '84'} Jul 11 14:06:25.621394 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:06:25.621394 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:06:25.622498 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:06:25.628270 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:06:25.628270 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:06:25.628270 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:06:25.628270 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:06:25.628270 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 14:06:25.628270 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:06:25.628270 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 11 14:06:25.628270 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jul 11 14:06:25.628270 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:06:25.628270 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jul 11 14:06:25.628270 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:06:25.628270 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:06:25.628270 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:06:25.628270 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:06:25.628270 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:06:25.628270 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 11 14:06:25.628270 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jul 11 14:06:25.628270 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-c5c224e9-bb83-415d-8b10-ad30476a0cb0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:06:25.629593 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-c5c224e9-bb83-415d-8b10-ad30476a0cb0 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.415779 Jul 11 14:06:25.629593 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 23/44] 10.222.0.66 () {60 vars in 1190 bytes} [Mon Jul 11 14:06:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:25.632250 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-be0f80c1-eeaa-4076-a856-2dfb1870090d admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:25.646432 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-be0f80c1-eeaa-4076-a856-2dfb1870090d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018363 Jul 11 14:06:25.646992 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 22/45] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Jul 11 14:06:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:06:25.656476 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-f16fed38-af5e-4ee0-a759-1e6a2a0f6fc8 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:25.670035 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-f16fed38-af5e-4ee0-a759-1e6a2a0f6fc8 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017053 Jul 11 14:06:25.670647 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 24/46] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Jul 11 14:06:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:06:25.680662 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-707483f7-8286-4cd6-ad68-ad6a3df2f555 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:25.686060 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.wsgi [None req-707483f7-8286-4cd6-ad68-ad6a3df2f555 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-707483f7-8286-4cd6-ad68-ad6a3df2f555 admin admin] Request method failure captured: Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Accept: application/json Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Accept-Encoding: gzip, deflate Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Connection: keep-alive Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Content-Length: 0 Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Host: 10.222.0.66 Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Openstack-Api-Version: compute 2.90 Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Openstack-System-Scope: None Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: User-Agent: python-novaclient Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Auth-Token: gAAAAABizC5gag1l4-Y5bSolpd6RoPaBkLu_eIoXNKJUvdEKbVZUdGdSjct4wnXJxlYj22Ds99DeOV2l4qUjOfmJcFpjLAlFImD96xR5OBeiOBuDpYs4KXoI2_ZRU9gmg0vWd8LOx0uR05dV2wsUFLosyWKmsmWcoSYWdAOW2jyzxNmDwnc2j-g Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Domain-Id: None Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Domain-Name: None Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Identity-Status: Confirmed Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Is-Admin-Project: True Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Project-Domain-Id: default Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Project-Domain-Name: Default Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Project-Id: 53f35d51b66c4aec847015cb4a904c77 Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Project-Name: admin Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Role: admin,reader,member Jul 11 14:06:25.687611 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Roles: admin,reader,member Jul 11 14:06:25.689270 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:06:25.689270 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Tenant: admin Jul 11 14:06:25.689270 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Tenant-Id: 53f35d51b66c4aec847015cb4a904c77 Jul 11 14:06:25.689270 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Tenant-Name: admin Jul 11 14:06:25.689270 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-User: admin Jul 11 14:06:25.689270 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-User-Domain-Id: default Jul 11 14:06:25.689270 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-User-Domain-Name: Default Jul 11 14:06:25.689270 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-User-Id: 477dddd95e9e4c9dab1e4c703d6c3e08 Jul 11 14:06:25.689270 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-User-Name: admin Jul 11 14:06:25.689270 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: method: > Jul 11 14:06:25.689270 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: exception: Flavor 84 could not be found. Jul 11 14:06:25.689270 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: action_args: {'id': '84'} Jul 11 14:06:25.689270 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:06:25.689270 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:06:25.690069 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:06:25.691711 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:06:25.691711 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:06:25.691711 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:06:25.691711 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:06:25.691711 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 14:06:25.691711 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:06:25.691711 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 11 14:06:25.691711 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 11 14:06:25.691711 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:06:25.691711 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 11 14:06:25.691711 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:06:25.691711 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:06:25.691711 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:06:25.691711 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:06:25.691711 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:06:25.691711 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 11 14:06:25.691711 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 11 14:06:25.691711 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-707483f7-8286-4cd6-ad68-ad6a3df2f555 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:06:25.693467 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-707483f7-8286-4cd6-ad68-ad6a3df2f555 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012559 Jul 11 14:06:25.693467 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 23/47] 10.222.0.66 () {60 vars in 1190 bytes} [Mon Jul 11 14:06:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:26.681599 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-f16fed38-af5e-4ee0-a759-1e6a2a0f6fc8 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:26.682694 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-f16fed38-af5e-4ee0-a759-1e6a2a0f6fc8 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jul 11 14:06:26.683092 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 25/48] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 11 14:06:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:27.231585 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0e40c311-875a-461e-beaf-063e7a3b29d6 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:27.237336 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.wsgi [None req-0e40c311-875a-461e-beaf-063e7a3b29d6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0e40c311-875a-461e-beaf-063e7a3b29d6 admin admin] Request method failure captured: Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Accept: application/json Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Accept-Encoding: gzip, deflate Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Connection: keep-alive Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Content-Length: 0 Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Host: 10.222.0.66 Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Openstack-Api-Version: compute 2.90 Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Openstack-System-Scope: None Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: User-Agent: python-novaclient Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Auth-Token: gAAAAABizC5iVwxTkfH9Ap_BCXmzvsX8Y1K4e6bkyCZfBFzo1VYfnd1MHJ0cUNqfpXgdpFjkUJ0PpxCzNKBBJ_hp9hVrShqhaPwP-RcRPkCg4MpREOfxDSLb3lMtoHgOvglJyG5Xx7NizqWyVNYaPvzmq9np_WmHMTqJgJtKAitEwoBczi46dgo Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Domain-Id: None Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Domain-Name: None Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Identity-Status: Confirmed Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Is-Admin-Project: True Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Project-Domain-Id: default Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Project-Domain-Name: Default Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Project-Id: 53f35d51b66c4aec847015cb4a904c77 Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Project-Name: admin Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Role: admin,reader,member Jul 11 14:06:27.238978 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Roles: admin,reader,member Jul 11 14:06:27.240569 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:06:27.240569 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Tenant: admin Jul 11 14:06:27.240569 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Tenant-Id: 53f35d51b66c4aec847015cb4a904c77 Jul 11 14:06:27.240569 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-Tenant-Name: admin Jul 11 14:06:27.240569 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-User: admin Jul 11 14:06:27.240569 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-User-Domain-Id: default Jul 11 14:06:27.240569 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-User-Domain-Name: Default Jul 11 14:06:27.240569 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-User-Id: 477dddd95e9e4c9dab1e4c703d6c3e08 Jul 11 14:06:27.240569 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: X-User-Name: admin Jul 11 14:06:27.240569 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: method: > Jul 11 14:06:27.240569 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: exception: Flavor 451 could not be found. Jul 11 14:06:27.240569 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: action_args: {'id': '451'} Jul 11 14:06:27.240569 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:06:27.240569 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:06:27.241411 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:06:27.243032 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:06:27.243032 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:06:27.243032 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:06:27.243032 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:06:27.243032 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 14:06:27.243032 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:06:27.243032 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 11 14:06:27.243032 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 11 14:06:27.243032 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:06:27.243032 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 11 14:06:27.243032 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:06:27.243032 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:06:27.243032 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:06:27.243032 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:06:27.243032 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:06:27.243032 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 11 14:06:27.243032 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 11 14:06:27.243032 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0e40c311-875a-461e-beaf-063e7a3b29d6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:06:27.244297 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-0e40c311-875a-461e-beaf-063e7a3b29d6 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.415407 Jul 11 14:06:27.244297 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 24/49] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Jul 11 14:06:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:27.250137 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-11275ceb-6f67-4876-849b-04a4032d6598 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:27.264398 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-11275ceb-6f67-4876-849b-04a4032d6598 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017844 Jul 11 14:06:27.264932 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 26/50] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Jul 11 14:06:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:06:27.274838 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-352391c6-0785-4244-ab6b-aebb2351193f admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:27.290430 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-352391c6-0785-4244-ab6b-aebb2351193f admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019117 Jul 11 14:06:27.290970 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 25/51] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Jul 11 14:06:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:06:27.300485 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-c23da805-55cd-4efc-ba24-c6906bd77e00 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:27.306453 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.wsgi [None req-c23da805-55cd-4efc-ba24-c6906bd77e00 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-c23da805-55cd-4efc-ba24-c6906bd77e00 admin admin] Request method failure captured: Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Accept: application/json Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Accept-Encoding: gzip, deflate Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Connection: keep-alive Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Content-Length: 0 Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Host: 10.222.0.66 Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Openstack-Api-Version: compute 2.90 Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Openstack-System-Scope: None Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: User-Agent: python-novaclient Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Auth-Token: gAAAAABizC5iVwxTkfH9Ap_BCXmzvsX8Y1K4e6bkyCZfBFzo1VYfnd1MHJ0cUNqfpXgdpFjkUJ0PpxCzNKBBJ_hp9hVrShqhaPwP-RcRPkCg4MpREOfxDSLb3lMtoHgOvglJyG5Xx7NizqWyVNYaPvzmq9np_WmHMTqJgJtKAitEwoBczi46dgo Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Domain-Id: None Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Domain-Name: None Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Identity-Status: Confirmed Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Is-Admin-Project: True Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Project-Domain-Id: default Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Project-Domain-Name: Default Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Project-Id: 53f35d51b66c4aec847015cb4a904c77 Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Project-Name: admin Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Role: admin,reader,member Jul 11 14:06:27.308068 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Roles: admin,reader,member Jul 11 14:06:27.309691 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/53f35d51b66c4aec847015cb4a904c77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:06:27.309691 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Tenant: admin Jul 11 14:06:27.309691 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Tenant-Id: 53f35d51b66c4aec847015cb4a904c77 Jul 11 14:06:27.309691 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-Tenant-Name: admin Jul 11 14:06:27.309691 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-User: admin Jul 11 14:06:27.309691 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-User-Domain-Id: default Jul 11 14:06:27.309691 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-User-Domain-Name: Default Jul 11 14:06:27.309691 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-User-Id: 477dddd95e9e4c9dab1e4c703d6c3e08 Jul 11 14:06:27.309691 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: X-User-Name: admin Jul 11 14:06:27.309691 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: method: > Jul 11 14:06:27.309691 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: exception: Flavor 451 could not be found. Jul 11 14:06:27.309691 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: action_args: {'id': '451'} Jul 11 14:06:27.309691 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:06:27.309691 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:06:27.310624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:06:27.311938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:06:27.311938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:06:27.311938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:06:27.311938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:06:27.311938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 14:06:27.311938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:06:27.311938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 11 14:06:27.311938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jul 11 14:06:27.311938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:06:27.311938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jul 11 14:06:27.311938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:06:27.311938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:06:27.311938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:06:27.311938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:06:27.311938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:06:27.311938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 11 14:06:27.311938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jul 11 14:06:27.311938 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-c23da805-55cd-4efc-ba24-c6906bd77e00 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:06:27.313157 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-c23da805-55cd-4efc-ba24-c6906bd77e00 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012802 Jul 11 14:06:27.313157 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 27/52] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Jul 11 14:06:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 11 14:06:28.293553 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-352391c6-0785-4244-ab6b-aebb2351193f admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:28.294602 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-352391c6-0785-4244-ab6b-aebb2351193f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 11 14:06:28.294992 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 26/53] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 11 14:06:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:28.835283 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-d83fad74-0644-4c32-a2a2-29cd2ecc5eca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:06:28.854576 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-d83fad74-0644-4c32-a2a2-29cd2ecc5eca admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.417650 Jul 11 14:06:28.855133 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 28/54] 10.222.0.66 () {64 vars in 1235 bytes} [Mon Jul 11 14:06:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:06:29.852123 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-352391c6-0785-4244-ab6b-aebb2351193f admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:29.853136 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-352391c6-0785-4244-ab6b-aebb2351193f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 11 14:06:29.853539 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 27/55] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 11 14:06:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:30.398570 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-96e370fe-4944-4d44-a861-ab7ce15237e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:06:30.415810 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-96e370fe-4944-4d44-a861-ab7ce15237e7 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.423019 Jul 11 14:06:30.416358 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 29/56] 10.222.0.66 () {64 vars in 1235 bytes} [Mon Jul 11 14:06:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:06:31.414893 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-352391c6-0785-4244-ab6b-aebb2351193f admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:31.415907 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-352391c6-0785-4244-ab6b-aebb2351193f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jul 11 14:06:31.416303 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 28/57] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 11 14:06:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:31.960931 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-1c0c00b9-8d6d-4dc7-ba9b-c3414fe6d345 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:06:31.978600 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-1c0c00b9-8d6d-4dc7-ba9b-c3414fe6d345 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.417745 Jul 11 14:06:31.979302 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 30/58] 10.222.0.66 () {64 vars in 1235 bytes} [Mon Jul 11 14:06:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:06:32.961833 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-352391c6-0785-4244-ab6b-aebb2351193f admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:32.962945 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-352391c6-0785-4244-ab6b-aebb2351193f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001645 Jul 11 14:06:32.963342 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 29/59] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 11 14:06:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:33.497775 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-f4a5e2c2-934b-4086-a7e6-69479e07d76b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:06:33.517409 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-f4a5e2c2-934b-4086-a7e6-69479e07d76b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.415043 Jul 11 14:06:33.517930 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 31/60] 10.222.0.66 () {64 vars in 1235 bytes} [Mon Jul 11 14:06:33 2022] POST /compute/v2.1/flavors => generated 409 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 14:06:34.502109 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-352391c6-0785-4244-ab6b-aebb2351193f admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:34.503194 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-352391c6-0785-4244-ab6b-aebb2351193f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 11 14:06:34.503686 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 30/61] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 11 14:06:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:35.047177 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-bc7e36d9-8872-4bfc-9a0e-7ea185b043de admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:35.066631 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-bc7e36d9-8872-4bfc-9a0e-7ea185b043de admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.422306 Jul 11 14:06:35.067204 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 32/62] 10.222.0.66 () {60 vars in 1202 bytes} [Mon Jul 11 14:06:34 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:27.958805 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-352391c6-0785-4244-ab6b-aebb2351193f admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:27.959828 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-352391c6-0785-4244-ab6b-aebb2351193f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jul 11 14:07:27.960237 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 31/63] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 11 14:07:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:27.971697 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:28.365508 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-2b227080-5552-442a-8997-b4d80c41a58d admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:28.385569 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-2b227080-5552-442a-8997-b4d80c41a58d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.419209 Jul 11 14:07:28.386022 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 33/64] 10.222.0.66 () {60 vars in 1291 bytes} [Mon Jul 11 14:07:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:28.412008 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-8fca8126-7a28-4cc9-a7e5-257eb11f8210 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:28.415521 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:28.420923 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-8fca8126-7a28-4cc9-a7e5-257eb11f8210 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015435 Jul 11 14:07:28.421456 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 32/65] 10.222.0.66 () {60 vars in 1282 bytes} [Mon Jul 11 14:07:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:28.433005 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-ce7d45cc-fbca-4c98-85e7-93ef421173a7 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:28.441015 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-ce7d45cc-fbca-4c98-85e7-93ef421173a7 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011499 Jul 11 14:07:28.441747 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 34/66] 10.222.0.66 () {60 vars in 1285 bytes} [Mon Jul 11 14:07:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:28.453726 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-31e807a8-d432-43e9-aca3-06d528f8d125 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:28.462945 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-31e807a8-d432-43e9-aca3-06d528f8d125 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012920 Jul 11 14:07:28.463689 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 33/67] 10.222.0.66 () {60 vars in 1285 bytes} [Mon Jul 11 14:07:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:28.475905 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-811994e4-afc0-434f-8021-2f330d865555 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:28.483643 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-811994e4-afc0-434f-8021-2f330d865555 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012255 Jul 11 14:07:28.484167 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 35/68] 10.222.0.66 () {60 vars in 1282 bytes} [Mon Jul 11 14:07:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:09.794201 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-31e807a8-d432-43e9-aca3-06d528f8d125 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:09.795236 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-31e807a8-d432-43e9-aca3-06d528f8d125 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002189 Jul 11 14:11:09.795636 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 34/69] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 11 14:11:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:11:09.938867 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_api:SELECT=6 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:10.102218 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-f7a5fdc9-6686-496f-8907-94ed00a71225 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:10.103811 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:11:10.103811 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: warnings.warn(msg) Jul 11 14:11:10.105443 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-f7a5fdc9-6686-496f-8907-94ed00a71225 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:10.106096 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-f7a5fdc9-6686-496f-8907-94ed00a71225 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:10.107284 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-f7a5fdc9-6686-496f-8907-94ed00a71225 admin admin] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:10.107735 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-f7a5fdc9-6686-496f-8907-94ed00a71225 admin admin] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:10.141941 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-f7a5fdc9-6686-496f-8907-94ed00a71225 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.204453 Jul 11 14:11:10.142533 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 36/70] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Jul 11 14:11:09 2022] GET /compute/v2.1/os-services => generated 794 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:11:11.016870 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-31e807a8-d432-43e9-aca3-06d528f8d125 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:11.017991 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-31e807a8-d432-43e9-aca3-06d528f8d125 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Jul 11 14:11:11.018412 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 35/71] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 11 14:11:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:11:11.230219 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-25c35a41-fd70-4e8d-a545-8f2566b2aab8 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:11.231688 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:11:11.231688 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: warnings.warn(msg) Jul 11 14:11:11.232891 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-25c35a41-fd70-4e8d-a545-8f2566b2aab8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:11.233337 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-25c35a41-fd70-4e8d-a545-8f2566b2aab8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:11.234190 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-25c35a41-fd70-4e8d-a545-8f2566b2aab8 admin admin] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:11.234624 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-25c35a41-fd70-4e8d-a545-8f2566b2aab8 admin admin] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:11.254592 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-25c35a41-fd70-4e8d-a545-8f2566b2aab8 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.081123 Jul 11 14:11:11.255168 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 37/72] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Jul 11 14:11:11 2022] GET /compute/v2.1/os-services => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:11:22.504822 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-31e807a8-d432-43e9-aca3-06d528f8d125 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:22.505834 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-31e807a8-d432-43e9-aca3-06d528f8d125 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 11 14:11:22.506250 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 36/73] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 11 14:11:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:11:22.650132 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_cell0:SELECT=4 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:22.650905 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_cell1:SELECT=4 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:22.651554 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_api:SELECT=8 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:22.701724 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-4f85308f-a79c-4eb9-95c4-5ba66594c3af admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:22.702934 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:11:22.702934 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: warnings.warn(msg) Jul 11 14:11:22.704157 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-4f85308f-a79c-4eb9-95c4-5ba66594c3af admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:22.704607 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-4f85308f-a79c-4eb9-95c4-5ba66594c3af admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:22.705459 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-4f85308f-a79c-4eb9-95c4-5ba66594c3af admin admin] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:22.705901 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-4f85308f-a79c-4eb9-95c4-5ba66594c3af admin admin] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:22.732109 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-4f85308f-a79c-4eb9-95c4-5ba66594c3af admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.086298 Jul 11 14:11:22.732598 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 38/74] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Jul 11 14:11:22 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:23.581832 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-31e807a8-d432-43e9-aca3-06d528f8d125 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:23.582877 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-31e807a8-d432-43e9-aca3-06d528f8d125 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001645 Jul 11 14:11:23.583433 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 37/75] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 11 14:11:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:11:23.781324 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-67e1c42a-70c9-4583-9d4b-9fe98d829829 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:23.782534 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:11:23.782534 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: warnings.warn(msg) Jul 11 14:11:23.783829 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-67e1c42a-70c9-4583-9d4b-9fe98d829829 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:23.784225 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-67e1c42a-70c9-4583-9d4b-9fe98d829829 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:23.785030 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-67e1c42a-70c9-4583-9d4b-9fe98d829829 admin admin] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:23.785466 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-67e1c42a-70c9-4583-9d4b-9fe98d829829 admin admin] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:23.807154 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-67e1c42a-70c9-4583-9d4b-9fe98d829829 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.079290 Jul 11 14:11:23.807700 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 39/76] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Jul 11 14:11:23 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:12:22.873256 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: Mon Jul 11 14:12:22 2022 - graceful shutdown triggered... Jul 11 14:12:22.873800 dv-cinder-819149-10-iscsi devstack@n-api.service[103348]: Gracefully killing worker 1 (pid: 103348)... Jul 11 14:12:22.873382 dv-cinder-819149-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 11 14:12:22.874665 dv-cinder-819149-10-iscsi devstack@n-api.service[103349]: Gracefully killing worker 2 (pid: 103349)... Jul 11 14:12:23.874401 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: worker 1 buried after 1 seconds Jul 11 14:12:23.874401 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: worker 2 buried after 1 seconds Jul 11 14:12:23.874401 dv-cinder-819149-10-iscsi devstack@n-api.service[103347]: goodbye to uWSGI. Jul 11 14:12:23.876018 dv-cinder-819149-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 11 14:12:23.876831 dv-cinder-819149-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 11 14:12:23.879839 dv-cinder-819149-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 11 14:12:23.892609 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 11 14:12:23.895416 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 14:12:23 2022] *** Jul 11 14:12:23.895416 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 14:12:23.895416 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 14:12:23.895416 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: nodename: dv-cinder-819149-10-iscsi Jul 11 14:12:23.895416 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: machine: x86_64 Jul 11 14:12:23.895416 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: clock source: unix Jul 11 14:12:23.895416 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: pcre jit disabled Jul 11 14:12:23.895416 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: detected number of CPU cores: 4 Jul 11 14:12:23.895416 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: current working directory: / Jul 11 14:12:23.895416 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: detected binary path: /usr/bin/uwsgi-core Jul 11 14:12:23.895416 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: your processes number limit is 47680 Jul 11 14:12:23.895416 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: your memory page size is 4096 bytes Jul 11 14:12:23.896344 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: detected max file descriptor number: 2048 Jul 11 14:12:23.896344 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: lock engine: pthread robust mutexes Jul 11 14:12:23.896344 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: thunder lock: enabled Jul 11 14:12:23.896344 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 11 14:12:23.896344 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 14:12:23.940361 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: Python main interpreter initialized at 0x561290e209c0 Jul 11 14:12:23.940361 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: python threads support enabled Jul 11 14:12:23.940361 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: your server socket listen backlog is limited to 100 connections Jul 11 14:12:23.940361 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: your mercy for graceful operations on workers is 90 seconds Jul 11 14:12:23.941010 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 14:12:23.941010 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: *** Operational MODE: preforking *** Jul 11 14:12:23.941263 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: *** uWSGI is running in multiple interpreter mode *** Jul 11 14:12:23.941263 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: spawned uWSGI master process (pid: 117906) Jul 11 14:12:23.941546 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: spawned uWSGI worker 1 (pid: 117920, cores: 1) Jul 11 14:12:23.941315 dv-cinder-819149-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 11 14:12:23.942052 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: spawned uWSGI worker 2 (pid: 117921, cores: 1) Jul 11 14:12:23.942052 dv-cinder-819149-10-iscsi devstack@n-api.service[117906]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 14:12:24.605426 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 14:12:24.605898 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 14:12:25.818097 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:12:25.818097 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: from cryptography.utils import int_from_bytes Jul 11 14:12:25.818764 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:12:25.818764 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: from cryptography.utils import int_from_bytes Jul 11 14:12:25.820636 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:12:25.820636 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: from cryptography.utils import int_from_bytes Jul 11 14:12:25.821075 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:12:25.821075 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: from cryptography.utils import int_from_bytes Jul 11 14:12:28.143050 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 14:12:28.143050 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 14:12:28.143506 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 14:12:28.143589 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 14:12:28.143795 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 14:12:28.144460 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.144967 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.145285 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.145608 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.145943 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.146281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.146609 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.146931 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.147263 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.147532 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.147849 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.148177 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-10-iscsi {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.148505 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.148815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.149127 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.149448 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.149754 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.150075 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.150529 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.150969 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 14:12:28.151389 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.151496 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 14:12:28.151772 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 14:12:28.152126 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 14:12:28.152413 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 14:12:28.152938 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.153251 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.153376 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.153606 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.153803 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.153924 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.154127 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.154433 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.154683 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.154899 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.155135 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.155343 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.155597 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.155849 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.156063 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.156538 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.156764 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.156990 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.157229 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.157668 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.157668 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.157878 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-10-iscsi {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.157967 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-10-iscsi {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.158059 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.158186 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.158276 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.158361 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.158448 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.158543 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.158639 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.158742 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.158835 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.158929 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.159016 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.159095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.159193 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.159269 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.159341 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.159341 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.159477 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.160241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.160370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.160467 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.160564 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.160657 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.160759 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.160858 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.160956 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.161042 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.161141 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.161234 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.161327 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.161423 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.161590 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.161746 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.161904 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.162055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.162264 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.162400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.162582 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.162684 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.162953 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.163059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-10-iscsi {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.163273 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.163369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.163594 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.163689 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.163909 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.164009 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.164159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.164329 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.164432 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.164646 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.164749 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.164959 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.165055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.165316 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.165417 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.165624 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.165726 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.165931 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.166033 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.166300 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.166402 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.166574 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.166686 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.166881 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.166977 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.167187 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.167287 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.167492 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.167598 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.167803 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.167908 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.168114 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.168207 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.169197 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.169305 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.169523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.169624 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.169848 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.170056 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.170392 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.170505 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.170595 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.170688 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.170785 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.170878 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.171110 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.171221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.171439 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.171546 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.171699 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.171795 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.171955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.172059 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.172280 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.172382 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.172603 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.172713 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.172984 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.173098 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.173240 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.173339 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.173526 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.173699 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.173836 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.173942 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.174147 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.174273 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.174430 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.174539 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.174734 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.174834 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.175041 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.175135 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.175359 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.175467 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.175669 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.175773 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.175977 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.176085 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.176283 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.176404 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.176586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.176696 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.176893 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.176987 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.177200 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.177295 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.177506 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.177611 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.177813 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.177907 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.178120 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.178342 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.178466 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.178568 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.178775 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.178881 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.179081 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.179183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.179383 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.179477 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.179693 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.179793 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.180008 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.180152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.180329 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.180448 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.180642 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.180765 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.180944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.181047 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.181207 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.181301 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.181511 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.181615 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.181821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.181923 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.182133 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.182245 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.182469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.182565 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.182782 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.182885 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.183094 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.183227 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.183399 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.183508 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.183705 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.183807 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.184744 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.184854 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.184931 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.185279 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.185589 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.185914 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.186253 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.186409 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.186584 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.186707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.186850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.186983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.187156 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.187336 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.187491 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.187674 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.187804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.188010 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.188135 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.188339 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.188462 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.188662 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.188989 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.189135 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.189299 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.189519 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.189653 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.189901 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.190134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.190318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.190540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.190922 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.191070 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.191213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.191386 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.191533 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.191845 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.191961 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.192215 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.192323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.192513 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.192615 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.192828 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.192994 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.193221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.193425 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.193591 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.193689 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.193776 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.193870 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.194075 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.194205 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.194445 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.194616 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.194711 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.194807 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.195040 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.195155 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.195342 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.195437 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.195656 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.195830 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.195977 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.199897 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.200076 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.200259 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.200556 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.200704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.200858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.201200 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.201342 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.201486 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.201634 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.201770 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.201914 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.202049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.202301 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.202451 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.202601 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.202745 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.202888 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.203029 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.203169 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.203287 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.203378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.203378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.203534 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.203620 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.203713 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.203713 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.203882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.203983 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.204082 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.204178 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.204272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:12:28.204360 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.204527 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.204624 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.204718 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.204812 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.204898 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.204989 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.205107 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.205198 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.205299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.205395 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.205483 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.205576 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.205677 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.205766 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.205852 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.205938 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.205938 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.206101 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.206217 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.206314 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.206403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.206489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.206574 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.206574 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.206751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.206839 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.206924 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.207017 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.207017 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.207190 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.207286 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.207380 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.207472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.207565 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.207657 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.207757 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.207850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.207937 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.208022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.208106 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.208201 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.208300 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.208395 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.208519 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.208686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.208884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.209036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.209214 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.209360 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.212778 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.212925 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.213071 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.213228 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.213228 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.213492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.213635 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.213774 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.213916 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.213916 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.214270 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.214407 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.214555 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.214690 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.214833 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.214977 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.215212 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.215367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.215559 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.216238 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.216384 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.216477 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.216572 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.216660 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.216753 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.216854 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.216943 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.217035 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.217130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.217224 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.217318 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.217414 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.217502 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.217588 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.217681 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.217810 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.217972 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.218074 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.218178 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.218320 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.218438 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.218560 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.218560 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.218896 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.219020 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.219138 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.219272 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.219400 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.219527 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.219643 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.219757 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.219870 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.219992 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.220114 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.220239 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.220363 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.220488 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.220610 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.220726 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.220839 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.220966 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.221081 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.221196 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.221316 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.221439 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.221568 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.221691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.221805 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.221926 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.222048 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.222182 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.222322 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.222446 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.222446 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.222686 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.222827 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.222969 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.223116 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.223251 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.223352 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.223446 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.223540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.223668 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.223816 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.223816 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.223816 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.223816 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.224309 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.224410 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.224410 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.224577 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.224664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.224756 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.224849 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.224943 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.225082 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.225178 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.225393 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.225488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.225704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.225808 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.226024 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.226129 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.226367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.226473 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.226689 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.226797 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.226999 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.227092 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.227312 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.227406 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.227621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.227722 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.227933 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.228026 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.228237 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.228329 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.228556 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.228660 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.228872 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.228986 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.229211 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.229313 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.229527 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.229629 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.229850 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.229950 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.230189 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.230312 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.230544 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.231433 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.231943 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.232057 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.232231 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.232410 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.232636 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.232787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.232933 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.233099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.233245 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.233414 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.233559 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.233705 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.233923 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.234089 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.234312 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.234429 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.234519 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.234613 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.234699 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.234791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.234878 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.235065 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.235198 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.235387 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.235510 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.235698 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.235818 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.236017 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.236113 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.236352 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.236447 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.236690 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.236793 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.237005 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.237100 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.237320 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.237414 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.237646 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.237750 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.237963 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.238058 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.238304 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.238417 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.238626 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.238734 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.238944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.239068 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.239254 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.239370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.239565 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.239691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.239881 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.239986 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.240192 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.240300 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.240506 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.240619 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.240812 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.240924 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.241130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.241233 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.241503 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.241625 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.241739 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.241841 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.242040 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.242136 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.242382 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.242485 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.242688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.242782 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.243003 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.243143 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.243323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.243453 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.243645 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.243750 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.243949 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.244043 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.244253 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.244487 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.244640 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.244805 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.244900 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.245124 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.245219 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.245438 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.245533 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.245738 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.245833 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.246106 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.246288 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.246430 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.247291 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.247874 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.247967 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.248068 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.248196 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.248361 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.248461 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.248688 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.248775 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.248915 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.249021 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.249239 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.249346 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.249543 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.249642 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.249870 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.249985 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.250289 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.250382 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.250521 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.250621 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.250822 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.250972 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.251166 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.251337 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.251424 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.251658 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.251764 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.251984 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.252070 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.252301 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.252386 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.252616 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.252998 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.252998 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.253158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.253239 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.253327 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.253507 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.253615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.253816 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.253909 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.254134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.254429 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.254522 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.254764 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.254856 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.255068 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.255151 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.255385 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.255529 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.255697 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.255820 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.256004 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.256105 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.256310 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.256406 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.256621 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.256715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.256947 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.257056 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.257277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.257387 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.257567 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.257669 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.257873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.257976 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.258260 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.258362 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.258492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.258895 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.259067 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.259162 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.259376 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.259518 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.259678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.259987 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.260288 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.260421 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.260593 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.260779 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.260913 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.261037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.261183 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.261315 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.261495 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.261618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.261846 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.261994 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.262117 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.262313 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.262583 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.262722 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.262910 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.263104 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.263347 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.263471 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.263714 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.263855 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.264020 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.264152 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.264324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.264448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.264648 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.264779 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.264961 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.265083 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.265271 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.265392 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.265628 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.265781 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.265899 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.266022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.266989 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.267175 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.267282 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.267374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.267469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.267557 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.267686 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.267814 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.267994 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.268086 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.268174 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.268261 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.268400 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.268548 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.268662 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.268760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.268760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.268929 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.269059 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.269209 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.269316 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.269521 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.269653 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.269826 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.269935 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.270131 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.270313 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.270468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.270567 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.270774 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.270879 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.271089 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.271187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.271407 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.271541 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.271701 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.271865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.272083 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.272235 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.272372 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.272504 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.272649 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.272750 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.272880 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.272984 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.273189 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.273363 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.273490 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.273594 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.273807 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.273909 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.274112 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.274367 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.274466 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.274561 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.274735 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.274831 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.275036 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.275139 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.275346 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.275650 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.276086 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.276306 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.276503 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.276707 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.276908 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.277154 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.277332 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.277539 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.277788 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.277958 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.277958 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.278296 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.278434 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.278573 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.278725 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.278863 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.279009 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.279147 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.279300 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.279517 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.279772 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.279926 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.280082 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.280241 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.280393 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.280556 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.280704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.280704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.280995 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.281149 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.281297 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.281475 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.281631 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.281795 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.281952 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.282133 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.282646 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.282849 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.283070 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.283236 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.283378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.283529 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.283689 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.283843 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.283981 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.284114 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.284247 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.284388 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.284569 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.284734 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.284871 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.284976 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.285069 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.285145 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.285245 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.285334 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.285427 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.285522 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.285615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.285702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.285793 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.285868 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.286337 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.286475 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.286650 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.286775 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.286903 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.287015 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.287202 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.287334 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.287459 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.287608 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.287778 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.287937 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.288109 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.288235 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.288235 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.288417 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.288507 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.288600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.288600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.288776 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.288863 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.289123 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.289330 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.289426 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.289713 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.289859 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.290091 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.290364 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.290456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.290577 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.293076 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.293196 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.293825 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.293928 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.294017 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.294186 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.294325 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.294424 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.294522 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.294611 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.294685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.294766 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.294860 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.294949 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.295043 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.295138 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.295225 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.295310 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.295438 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.295531 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.295628 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.295723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.295810 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.295897 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.295989 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.296077 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.296221 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.296342 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.296426 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.296645 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.296775 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.296920 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.297014 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.297141 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.297263 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.297367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.297456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.297555 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.297651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.297745 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.297832 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.297918 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.298003 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.298099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.298229 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.298382 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.298475 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.298716 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.298814 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.299021 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.299118 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.299329 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.299426 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.299633 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.299742 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.299974 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.300080 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.300257 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.300353 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.300619 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.300747 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.300886 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.300972 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.301189 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.301281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.301519 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.301616 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.301833 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.301920 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.302150 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.302256 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.302480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.302584 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.302798 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.302895 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.303105 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.303196 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.303415 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.303504 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.303718 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.303802 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.304026 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.304118 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.304327 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.304411 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.304630 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.304723 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.304945 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.305062 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.305245 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.305379 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.305562 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.305666 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.305883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.305977 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.306291 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.306450 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.306569 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.306798 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.306922 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.307046 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.307163 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.307286 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.307403 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.307599 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.307731 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.307919 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.308062 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.308238 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.308334 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.308561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.308656 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.308891 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.309506 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.309745 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.309972 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.310116 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.310323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.310500 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.310724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.310821 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.310934 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.311111 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.311232 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.311435 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.311596 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.311732 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.311849 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.312043 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.312152 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.312362 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.312506 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.312676 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.312772 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.312993 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.313098 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.313318 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.313413 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.313716 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.313810 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.314025 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.314130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.314378 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.314474 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.314695 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.314802 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.314998 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.315094 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.315301 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.315397 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.315611 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.315914 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.316218 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.316321 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.316539 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.316638 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.316847 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.316966 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.317159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.317302 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.317464 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.317625 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.317768 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.317944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.318075 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.318286 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.318385 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.318597 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.318709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.318905 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.319008 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.319220 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.319315 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.319546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.319655 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.319855 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.319952 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.320162 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.320259 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.320470 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.320636 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.320786 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.320942 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.321089 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.321241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.321399 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.321550 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.321701 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.321851 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.321995 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.322179 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.322329 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.322427 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.322637 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.322819 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.322957 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.323137 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.323287 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.323450 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.323616 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.323775 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.323950 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.324098 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.324262 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.324425 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.324600 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.324919 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.325013 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.325244 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.325349 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.325575 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.325711 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.325927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.326053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.326298 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.326431 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.326559 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.326684 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.326843 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.327067 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.327203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.327327 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.327445 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.327568 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.327730 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.327864 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.328035 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.328168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.328403 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.328527 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.328826 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.329040 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.329172 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.329457 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.333360 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.333537 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.333676 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.333906 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.333906 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.334144 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.334298 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.334298 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.334570 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.334817 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.334817 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.335344 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.335469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.335469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.335751 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.335939 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.335939 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.336176 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.336294 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.336408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.336532 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.336532 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.336749 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.336749 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.336749 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.337081 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.337081 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.337588 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.337767 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.337923 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.338078 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.338078 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.338388 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.338520 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.338520 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.338747 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.338872 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.339005 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.339121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.339121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.339364 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.339482 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.339482 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.339482 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.339482 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.339918 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.340075 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.340931 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.341246 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.341747 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.342084 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.342564 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.342752 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.343081 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.343389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.343699 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.344008 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.344394 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.344617 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.345120 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.345487 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.345876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.346204 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.346515 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.346670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.346837 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.347246 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.347512 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.347660 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.347803 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.347939 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.348275 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.348424 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.348662 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.348824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.349028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.349184 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.349381 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.349586 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.349745 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.350051 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.350329 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.350939 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.351293 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.351582 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.351741 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.352036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.352205 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.352364 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.352603 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.352767 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.352918 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.353076 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.353232 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.353389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.353621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.354057 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.354236 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.354392 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.354554 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.354744 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.354913 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.354913 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.355215 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.355372 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.355531 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.355874 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.356540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.356699 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.356699 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.357026 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.357026 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.357525 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.357796 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.357796 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.358132 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.358336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.358497 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.358660 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.358810 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.358967 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.359128 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.359277 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.359443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.359601 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.359751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.359939 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.360123 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.360123 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.360419 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.360575 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.360724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.360880 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.361049 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.361213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.361388 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.361622 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.361793 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.361976 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.362198 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.362369 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.362519 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.362668 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.362816 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.362972 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.363134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.363291 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.363449 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.363598 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.363753 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.363911 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.364069 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.364261 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.364417 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.364566 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.364715 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.364863 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.365032 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.365192 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.365350 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.365501 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.365658 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.365814 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.366087 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.366087 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.366416 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.366566 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.366715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.366886 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.367056 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.367206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.367357 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.367504 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.367661 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.367915 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.368072 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.368221 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.368413 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.368561 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.368709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.368866 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.369023 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.369194 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.369354 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.369511 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.369671 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.370184 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.370357 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.370518 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.370668 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.370815 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.370974 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.371131 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.371289 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.371505 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.371878 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.372050 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.372214 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.372398 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.372553 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.372743 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.372743 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.373041 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.373200 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.373358 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.373514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.373664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.373824 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.373983 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.374294 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.374456 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.374618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.374776 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.374926 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.375091 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.375241 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.375389 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.375546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.375696 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.375844 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.376014 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.376172 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.376330 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.376512 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.376679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.376679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.376987 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.377137 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.377298 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.377455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.377605 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.377764 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.377930 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.378221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.378381 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.378541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.378699 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.378865 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.379015 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.379171 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.379338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.379497 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.379646 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.379804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.379962 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.380128 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.380285 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.380435 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.380618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.380618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.380926 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.381083 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.381232 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.381388 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.381595 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.381768 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.381992 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.382190 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.382361 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.382510 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.382510 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.382815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.382964 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.383113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.383259 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.383408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.383821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.383976 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.384132 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.384281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.384428 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.384586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.384744 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.384893 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.385049 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.385199 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.385355 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.385518 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.385674 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.385831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.385988 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.386139 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.386364 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.386541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.386751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.386910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.387340 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.387513 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.387665 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.387858 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.388012 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.388188 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.388419 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.388584 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.388781 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.388781 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.389124 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.389284 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.389441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.389598 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.389757 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.389906 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.390097 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.390274 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.390437 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.390604 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.390768 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.390917 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.391065 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.391232 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.391232 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.391555 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.391719 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.391871 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.392156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.392360 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.392530 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.392530 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.392829 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.392979 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.393135 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.393286 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.393454 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.393618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.393768 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.393916 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.394073 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.394269 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.394463 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.394633 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.394633 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.394934 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.395084 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.395233 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.395391 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.395549 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.395698 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.395854 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.396003 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.396160 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.396350 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.396512 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.396716 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.396873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.397030 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.397188 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.397188 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.397563 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.397712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.397867 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.398017 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.398204 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.398422 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.398660 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.398816 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.398964 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.399121 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.399284 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.399435 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.399594 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.399744 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.399894 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.400061 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.400228 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.400386 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.400546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.400695 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.400853 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.401003 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.401160 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.401160 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.401160 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.401160 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.401729 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.401879 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.402041 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.402291 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.402511 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.403201 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.403354 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.403518 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.403675 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.403675 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.403968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.403968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.404263 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.404421 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.404421 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.404421 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.404871 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.405034 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.405193 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.405343 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.405492 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.405640 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.405789 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.405955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.406115 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.406347 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.406537 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.406692 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.406855 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.407017 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.407181 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.407338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.407338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.407338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.407778 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.407926 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.408096 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.408247 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.408404 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.408553 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.408804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.408974 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.409132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.409282 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.409432 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.409579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.409734 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.409896 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.410064 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.410244 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.410401 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.410626 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.410783 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.410942 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.411091 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.411247 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.411247 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.411547 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.411705 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.411864 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.412014 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.412174 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.412410 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.412574 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.412733 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.412919 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.413073 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.413222 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.413371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.413527 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.413690 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.413839 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.413996 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.414145 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.414329 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.414491 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.414688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.414688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.414986 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.415134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.415297 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.415454 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.415614 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.415771 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.415930 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.416086 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.416235 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.416408 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.416559 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.416714 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.416868 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.417023 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.417174 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.417331 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.417487 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.417644 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.417794 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.417941 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.418097 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.418910 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.419156 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.419311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.419596 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.419750 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.419899 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.420063 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.420222 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.420371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.420371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.420674 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.420832 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.420982 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.421142 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.421301 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.421450 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.421450 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.421747 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.421897 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.422045 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.422272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.422453 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.422683 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.422893 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.423044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.423213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.423362 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.423362 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.423362 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.423790 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.423947 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.423947 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.424231 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.424380 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.424543 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.424693 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.424849 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.424999 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.424999 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.425302 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.425461 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.425612 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.425769 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.425932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.426089 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.426275 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.426442 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.426650 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.426806 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.426963 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.427136 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.427136 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.427432 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.427588 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.427738 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.427887 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.428036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.428273 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.428425 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.428425 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.428707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.428856 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.429054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.429336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.429501 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.429662 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.429812 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.429961 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.430124 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.430124 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 14:12:28.430438 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.430438 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.430438 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.430901 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.431246 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.431568 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.431883 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.432195 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:12:28.432438 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 14:12:28.591208 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-1a17e2b9-3536-4d6d-8037-bc89de922362 None None] Registered counter for database nova_api Jul 11 14:12:28.591586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO dbcounter [None req-df8c6183-83fe-4eeb-8561-838fe66e73e1 None None] Registered counter for database nova_api Jul 11 14:12:28.614848 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-1a17e2b9-3536-4d6d-8037-bc89de922362 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:12:28.616748 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_db.sqlalchemy.engines [None req-df8c6183-83fe-4eeb-8561-838fe66e73e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117921) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:12:28.624204 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:12:28.624446 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writer thread running {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:12:28.681994 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.context [None req-df8c6183-83fe-4eeb-8561-838fe66e73e1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9ce20a7-cf1f-45a0-823d-be4011508976(cell1) {{(pid=117921) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 14:12:28.683720 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.context [None req-1a17e2b9-3536-4d6d-8037-bc89de922362 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9ce20a7-cf1f-45a0-823d-be4011508976(cell1) {{(pid=117920) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 14:12:28.686532 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df8c6183-83fe-4eeb-8561-838fe66e73e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:28.688121 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df8c6183-83fe-4eeb-8561-838fe66e73e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:28.688375 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a17e2b9-3536-4d6d-8037-bc89de922362 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:28.688925 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df8c6183-83fe-4eeb-8561-838fe66e73e1 None None] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:28.689999 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a17e2b9-3536-4d6d-8037-bc89de922362 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:28.690848 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a17e2b9-3536-4d6d-8037-bc89de922362 None None] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:28.690983 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df8c6183-83fe-4eeb-8561-838fe66e73e1 None None] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:28.692827 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a17e2b9-3536-4d6d-8037-bc89de922362 None None] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:28.692933 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO dbcounter [None req-df8c6183-83fe-4eeb-8561-838fe66e73e1 None None] Registered counter for database nova_cell0 Jul 11 14:12:28.694858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-1a17e2b9-3536-4d6d-8037-bc89de922362 None None] Registered counter for database nova_cell0 Jul 11 14:12:28.696937 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO dbcounter [None req-df8c6183-83fe-4eeb-8561-838fe66e73e1 None None] Registered counter for database nova_cell1 Jul 11 14:12:28.698928 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-1a17e2b9-3536-4d6d-8037-bc89de922362 None None] Registered counter for database nova_cell1 Jul 11 14:12:28.704878 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_db.sqlalchemy.engines [None req-df8c6183-83fe-4eeb-8561-838fe66e73e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117921) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:12:28.707095 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_db.sqlalchemy.engines [None req-df8c6183-83fe-4eeb-8561-838fe66e73e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117921) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:12:28.708806 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-1a17e2b9-3536-4d6d-8037-bc89de922362 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:12:28.709960 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-1a17e2b9-3536-4d6d-8037-bc89de922362 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:12:28.714895 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writer thread running {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:12:28.716628 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:12:28.719053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:12:28.720613 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writer thread running {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:12:28.863159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO dbcounter [None req-df8c6183-83fe-4eeb-8561-838fe66e73e1 None None] Registered counter for database nova_cell0 Jul 11 14:12:28.868797 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-1a17e2b9-3536-4d6d-8037-bc89de922362 None None] Registered counter for database nova_cell0 Jul 11 14:12:28.870174 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_db.sqlalchemy.engines [None req-df8c6183-83fe-4eeb-8561-838fe66e73e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117921) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:12:28.875683 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writer thread running {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:12:28.876593 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-1a17e2b9-3536-4d6d-8037-bc89de922362 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:12:28.881382 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:12:29.196903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: WARNING keystonemiddleware.auth_token [None req-df8c6183-83fe-4eeb-8561-838fe66e73e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 14:12:29.205027 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: WARNING keystonemiddleware.auth_token [None req-df8c6183-83fe-4eeb-8561-838fe66e73e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 14:12:29.211577 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-1a17e2b9-3536-4d6d-8037-bc89de922362 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 14:12:29.218918 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-1a17e2b9-3536-4d6d-8037-bc89de922362 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 14:12:29.551398 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: WARNING keystonemiddleware.auth_token [None req-df8c6183-83fe-4eeb-8561-838fe66e73e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 14:12:29.557438 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: WARNING keystonemiddleware.auth_token [None req-df8c6183-83fe-4eeb-8561-838fe66e73e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 14:12:29.563442 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561290e209c0 pid: 117921 (default app) Jul 11 14:12:29.566930 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-1a17e2b9-3536-4d6d-8037-bc89de922362 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 14:12:29.572955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-1a17e2b9-3536-4d6d-8037-bc89de922362 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 14:12:29.578376 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561290e209c0 pid: 117920 (default app) Jul 11 14:13:12.987220 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:12.988291 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:12.989464 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:12.990384 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:15.176883 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0b6c457f-f4d6-413c-b49b-b430a6009561 tempest-VolumesGetTestJSON-688053550 tempest-VolumesGetTestJSON-688053550-project] Action: 'create', calling method: .version_select at 0x7fc97cbd85e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1125664991", "metadata": {"Type": "work"}}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:16.167780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:16.172707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:16.177764 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:16.186782 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:16.319883 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0b6c457f-f4d6-413c-b49b-b430a6009561 tempest-VolumesGetTestJSON-688053550 tempest-VolumesGetTestJSON-688053550-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.352713 Jul 11 14:13:16.320996 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 1/1] 10.222.0.66 () {60 vars in 1155 bytes} [Mon Jul 11 14:13:12 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3355 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 11 14:13:16.333867 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6521c5e3-9c05-435f-89ee-d1a6236c9b18 tempest-VolumesGetTestJSON-688053550 tempest-VolumesGetTestJSON-688053550-project] Calling method '.version_select at 0x7fc97ca9d4c0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:16.435841 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6521c5e3-9c05-435f-89ee-d1a6236c9b18 tempest-VolumesGetTestJSON-688053550 tempest-VolumesGetTestJSON-688053550-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/22ecb980-ba6f-427a-af36-45876ab7bad6" status: 200 len: 353 microversion: 2.1 time: 0.106086 Jul 11 14:13:16.436843 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 2/2] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 11 14:13:16 2022] GET /compute/v2.1/os-volumes/22ecb980-ba6f-427a-af36-45876ab7bad6 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:16.544340 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b7e98b7a-aa3c-444f-a878-ca34076e0a96 tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] Calling method '.version_select at 0x7fc97cc1c280>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:17.448156 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d87e5f1a-02c8-4196-b77f-dd0487f88360 tempest-VolumesGetTestJSON-688053550 tempest-VolumesGetTestJSON-688053550-project] Calling method '.version_select at 0x7fc97ca9d790>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:17.463279 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b7e98b7a-aa3c-444f-a878-ca34076e0a96 tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c6b9c993-2329-4567-abbf-a5d12eb46571" status: 200 len: 350 microversion: 2.1 time: 1.302886 Jul 11 14:13:17.469924 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 1/3] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 11 14:13:16 2022] GET /compute/v2.1/os-volumes/c6b9c993-2329-4567-abbf-a5d12eb46571 => generated 350 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:17.559933 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d87e5f1a-02c8-4196-b77f-dd0487f88360 tempest-VolumesGetTestJSON-688053550 tempest-VolumesGetTestJSON-688053550-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/22ecb980-ba6f-427a-af36-45876ab7bad6" status: 200 len: 354 microversion: 2.1 time: 0.115929 Jul 11 14:13:17.566418 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 3/4] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 11 14:13:17 2022] GET /compute/v2.1/os-volumes/22ecb980-ba6f-427a-af36-45876ab7bad6 => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:13:17.572830 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3b3af355-08d9-41af-a6eb-0549314b57cd tempest-VolumesGetTestJSON-688053550 tempest-VolumesGetTestJSON-688053550-project] Calling method '.version_select at 0x7fc97cae84c0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:18.065076 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3b3af355-08d9-41af-a6eb-0549314b57cd tempest-VolumesGetTestJSON-688053550 tempest-VolumesGetTestJSON-688053550-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/22ecb980-ba6f-427a-af36-45876ab7bad6" status: 200 len: 354 microversion: 2.1 time: 0.497042 Jul 11 14:13:18.065919 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 2/5] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 11 14:13:17 2022] GET /compute/v2.1/os-volumes/22ecb980-ba6f-427a-af36-45876ab7bad6 => generated 354 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:18.085000 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cc5987fc-1e38-41c4-b7f5-51895a816309 tempest-VolumesGetTestJSON-688053550 tempest-VolumesGetTestJSON-688053550-project] Calling method '.version_select at 0x7fc97ca9dca0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:18.332174 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cc5987fc-1e38-41c4-b7f5-51895a816309 tempest-VolumesGetTestJSON-688053550 tempest-VolumesGetTestJSON-688053550-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/22ecb980-ba6f-427a-af36-45876ab7bad6" status: 202 len: 0 microversion: 2.1 time: 0.254087 Jul 11 14:13:18.333016 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 4/6] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 11 14:13:18 2022] DELETE /compute/v2.1/os-volumes/22ecb980-ba6f-427a-af36-45876ab7bad6 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:13:18.341763 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d957830d-c10c-4e10-8551-b84e4b406aa9 tempest-VolumesGetTestJSON-688053550 tempest-VolumesGetTestJSON-688053550-project] Calling method '.version_select at 0x7fc97cae8c10>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:18.650981 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d957830d-c10c-4e10-8551-b84e4b406aa9 tempest-VolumesGetTestJSON-688053550 tempest-VolumesGetTestJSON-688053550-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/22ecb980-ba6f-427a-af36-45876ab7bad6" status: 200 len: 353 microversion: 2.1 time: 0.313665 Jul 11 14:13:18.651699 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 3/7] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 11 14:13:18 2022] GET /compute/v2.1/os-volumes/22ecb980-ba6f-427a-af36-45876ab7bad6 => generated 353 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:19.291251 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-08016b7c-54b2-4966-b4d4-dd657d589084 tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] Calling method '.version_select at 0x7fc97caaf3a0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:19.413599 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-08016b7c-54b2-4966-b4d4-dd657d589084 tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/40285582-e1f9-4adb-8192-8742b345e3a8" status: 200 len: 350 microversion: 2.1 time: 0.126922 Jul 11 14:13:19.422368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 5/8] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 11 14:13:19 2022] GET /compute/v2.1/os-volumes/40285582-e1f9-4adb-8192-8742b345e3a8 => generated 350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:19.664881 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b2910692-a58d-4715-984f-85acec57a465 tempest-VolumesGetTestJSON-688053550 tempest-VolumesGetTestJSON-688053550-project] Calling method '.version_select at 0x7fc97cae8dc0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:20.127413 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-b2910692-a58d-4715-984f-85acec57a465 tempest-VolumesGetTestJSON-688053550 tempest-VolumesGetTestJSON-688053550-project] HTTP exception thrown: Volume 22ecb980-ba6f-427a-af36-45876ab7bad6 could not be found. Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b2910692-a58d-4715-984f-85acec57a465 tempest-VolumesGetTestJSON-688053550 tempest-VolumesGetTestJSON-688053550-project] Request method failure captured: Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/os-volumes/22ecb980-ba6f-427a-af36-45876ab7bad6 HTTP/1.1 Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizC_4QrnQeyNxnOVVKbBdeDmYHUz_nL8Xj1qF4Lyb2F2V6nzhQaUswJMF3h4u-4AHhW8Mad9ZD6R85Gp09LnayeYmIh1kjyI1wMWOdTsZNWm2AOaYlUCzA-4mece8YXUD2IdIwLvW-0T4_0m6n8aBNaXtIqS85WidttcOk8IckBKUMCw Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 7115292b1995402489d8d56d271179cb Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesGetTestJSON-688053550 Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:13:20.135701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:13:20.137390 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7115292b1995402489d8d56d271179cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7115292b1995402489d8d56d271179cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7115292b1995402489d8d56d271179cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7115292b1995402489d8d56d271179cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:13:20.137390 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesGetTestJSON-688053550 Jul 11 14:13:20.137390 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7115292b1995402489d8d56d271179cb Jul 11 14:13:20.137390 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesGetTestJSON-688053550 Jul 11 14:13:20.137390 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesGetTestJSON-688053550-project Jul 11 14:13:20.137390 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:13:20.137390 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:13:20.137390 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: cb84443706474e58892b2b203104e529 Jul 11 14:13:20.137390 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesGetTestJSON-688053550-project Jul 11 14:13:20.137390 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: Jul 11 14:13:20.137390 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Volume 22ecb980-ba6f-427a-af36-45876ab7bad6 could not be found. Jul 11 14:13:20.137390 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': '22ecb980-ba6f-427a-af36-45876ab7bad6'} Jul 11 14:13:20.137390 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 22ecb980-ba6f-427a-af36-45876ab7bad6 could not be found. (HTTP 404) (Request-ID: req-85bedfab-8634-48dc-9729-953c53d5068e) Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:20.138323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:13:20.139448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 22ecb980-ba6f-427a-af36-45876ab7bad6 could not be found. Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 14:13:20.140371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:13:20.141671 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 22ecb980-ba6f-427a-af36-45876ab7bad6 could not be found. Jul 11 14:13:20.141671 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:13:20.141671 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:20.141671 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:13:20.141671 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:20.141671 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:13:20.141671 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:13:20.141671 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:13:20.141671 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:13:20.141671 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 22ecb980-ba6f-427a-af36-45876ab7bad6 could not be found. Jul 11 14:13:20.141671 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:13:20.143789 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b2910692-a58d-4715-984f-85acec57a465 tempest-VolumesGetTestJSON-688053550 tempest-VolumesGetTestJSON-688053550-project] Returning 404 to user: Volume 22ecb980-ba6f-427a-af36-45876ab7bad6 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:13:20.145996 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b2910692-a58d-4715-984f-85acec57a465 tempest-VolumesGetTestJSON-688053550 tempest-VolumesGetTestJSON-688053550-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/22ecb980-ba6f-427a-af36-45876ab7bad6" status: 404 len: 109 microversion: 2.1 time: 0.487077 Jul 11 14:13:20.150256 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 4/9] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 11 14:13:19 2022] GET /compute/v2.1/os-volumes/22ecb980-ba6f-427a-af36-45876ab7bad6 => generated 109 bytes in 491 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:13:22.846375 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2a40b399-f933-41c5-b616-0ec2767be512 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1065583142", "imageRef": "67874ac7-fac8-4d6d-9cd1-9091ecb957b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:23.081102 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-2a40b399-f933-41c5-b616-0ec2767be512 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] validate_networks() for [('53933bc7-750b-4043-bebb-e444933bfa00', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:13:24.828641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-399b4a3c-e864-469f-b75b-ecf4d4c7586c tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] Calling method '.version_select at 0x7fc97d483a60>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:24.983921 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-399b4a3c-e864-469f-b75b-ecf4d4c7586c tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/0037844c-ee5b-485e-a738-a602ada6270a" status: 200 len: 351 microversion: 2.1 time: 0.160888 Jul 11 14:13:24.984897 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 5/10] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 11 14:13:24 2022] GET /compute/v2.1/os-volumes/0037844c-ee5b-485e-a738-a602ada6270a => generated 351 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:13:24.998599 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-540c5b91-11df-48b3-ae1d-8adf65e8d874 tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] Calling method '.version_select at 0x7fc97cae8e50>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:25.140619 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-540c5b91-11df-48b3-ae1d-8adf65e8d874 tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.148458 Jul 11 14:13:25.141801 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 6/11] 10.222.0.66 () {58 vars in 1133 bytes} [Mon Jul 11 14:13:24 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:25.153679 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e0dd1d11-d169-48ba-85d4-8a199681fc3e tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] Calling method '.version_select at 0x7fc97ca088b0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:25.283208 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e0dd1d11-d169-48ba-85d4-8a199681fc3e tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.133363 Jul 11 14:13:25.284028 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 7/12] 10.222.0.66 () {58 vars in 1148 bytes} [Mon Jul 11 14:13:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:13:25.297105 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2887f2c8-339b-43a6-919e-15e1cd8089f3 tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] Calling method '.version_select at 0x7fc97ca08940>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:25.461517 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2887f2c8-339b-43a6-919e-15e1cd8089f3 tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.168512 Jul 11 14:13:25.462704 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 8/13] 10.222.0.66 () {58 vars in 1133 bytes} [Mon Jul 11 14:13:25 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:25.474892 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d399b89c-aae1-4dce-ae2a-a9078bb2ee9e tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] Calling method '.version_select at 0x7fc97cae8d30>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:25.850443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d399b89c-aae1-4dce-ae2a-a9078bb2ee9e tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.380249 Jul 11 14:13:25.851275 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 9/14] 10.222.0.66 () {58 vars in 1166 bytes} [Mon Jul 11 14:13:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:25.864110 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8f86e681-2f15-472a-be13-db14e99ba668 tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] Calling method '.version_select at 0x7fc97d483820>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:26.134525 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8f86e681-2f15-472a-be13-db14e99ba668 tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.274577 Jul 11 14:13:26.142022 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 10/15] 10.222.0.66 () {58 vars in 1169 bytes} [Mon Jul 11 14:13:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:26.156832 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cdc4bd9f-2a04-46d4-bc01-7b0f73a483fb tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] Calling method '.version_select at 0x7fc97ca51dc0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:26.431316 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cdc4bd9f-2a04-46d4-bc01-7b0f73a483fb tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.281320 Jul 11 14:13:26.432406 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 11/16] 10.222.0.66 () {58 vars in 1154 bytes} [Mon Jul 11 14:13:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:26.443450 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f4c611dc-5816-49ac-a5a7-59764223f0f5 tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] Calling method '.version_select at 0x7fc97ca08dc0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:26.515323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-2a40b399-f933-41c5-b616-0ec2767be512 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:13:26.515772 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-2a40b399-f933-41c5-b616-0ec2767be512 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:13:26.516354 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-2a40b399-f933-41c5-b616-0ec2767be512 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:13:26.516828 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-2a40b399-f933-41c5-b616-0ec2767be512 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:13:26.517310 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-2a40b399-f933-41c5-b616-0ec2767be512 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:13:26.545212 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2a40b399-f933-41c5-b616-0ec2767be512 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:26.547813 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2a40b399-f933-41c5-b616-0ec2767be512 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:26.548988 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2a40b399-f933-41c5-b616-0ec2767be512 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:26.551214 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2a40b399-f933-41c5-b616-0ec2767be512 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:26.629690 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-2a40b399-f933-41c5-b616-0ec2767be512 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Getting quotas for project 15d95b0cae244d99885be229335ea541. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:13:26.633908 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f4c611dc-5816-49ac-a5a7-59764223f0f5 tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.194462 Jul 11 14:13:26.634751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 12/17] 10.222.0.66 () {58 vars in 1187 bytes} [Mon Jul 11 14:13:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:13:26.647228 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-87e2ec8b-2e52-411c-991f-3402ab89a6db tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] Calling method '.version_select at 0x7fc97ca08c10>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:26.656907 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-2a40b399-f933-41c5-b616-0ec2767be512 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Getting quotas for user 39a5cea0a591453581a9d98ff796d973 and project 15d95b0cae244d99885be229335ea541. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:13:26.706644 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2a40b399-f933-41c5-b616-0ec2767be512 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:13:26.716269 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2a40b399-f933-41c5-b616-0ec2767be512 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67874ac7-fac8-4d6d-9cd1-9091ecb957b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:13:26.879180 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-87e2ec8b-2e52-411c-991f-3402ab89a6db tempest-VolumesTestJSON-2026442873 tempest-VolumesTestJSON-2026442873-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.236122 Jul 11 14:13:26.880532 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 13/18] 10.222.0.66 () {58 vars in 1154 bytes} [Mon Jul 11 14:13:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:26.936663 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2a40b399-f933-41c5-b616-0ec2767be512 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.438287 Jul 11 14:13:26.943125 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 6/19] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:13:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 4445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:13:26.947702 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7d519d5a-f359-4117-8bf8-44aaba98ce2e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:26.948882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7d519d5a-f359-4117-8bf8-44aaba98ce2e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:27.725624 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7d519d5a-f359-4117-8bf8-44aaba98ce2e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:27.755190 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7d519d5a-f359-4117-8bf8-44aaba98ce2e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1222 microversion: 2.1 time: 0.811163 Jul 11 14:13:27.760035 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 14/20] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:26 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1222 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:28.022737 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-212db45e-f37c-484f-ae2f-5ea034b092f6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-270423476", "imageRef": "67874ac7-fac8-4d6d-9cd1-9091ecb957b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:28.158216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-212db45e-f37c-484f-ae2f-5ea034b092f6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] validate_networks() for [('53933bc7-750b-4043-bebb-e444933bfa00', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:13:28.779638 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-26c5ab27-f90b-43a4-b7f2-c10868d03ae3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-309202767", "imageRef": "67874ac7-fac8-4d6d-9cd1-9091ecb957b6", "flavorRef": "452", "networks": [{"uuid": "17a358f5-9b62-4555-bdeb-2d53ddf08040"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:28.994129 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-26c5ab27-f90b-43a4-b7f2-c10868d03ae3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] validate_networks() for [('17a358f5-9b62-4555-bdeb-2d53ddf08040', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:13:29.841376 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-212db45e-f37c-484f-ae2f-5ea034b092f6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:13:29.842655 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-212db45e-f37c-484f-ae2f-5ea034b092f6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:13:29.843857 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-212db45e-f37c-484f-ae2f-5ea034b092f6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:13:29.844537 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-212db45e-f37c-484f-ae2f-5ea034b092f6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:13:29.845061 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-212db45e-f37c-484f-ae2f-5ea034b092f6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:13:29.896216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-212db45e-f37c-484f-ae2f-5ea034b092f6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:29.896480 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-212db45e-f37c-484f-ae2f-5ea034b092f6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:29.897326 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-212db45e-f37c-484f-ae2f-5ea034b092f6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:29.897771 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-212db45e-f37c-484f-ae2f-5ea034b092f6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:29.964100 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-212db45e-f37c-484f-ae2f-5ea034b092f6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Getting quotas for project 15d95b0cae244d99885be229335ea541. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:13:29.972197 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-212db45e-f37c-484f-ae2f-5ea034b092f6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Getting quotas for user 39a5cea0a591453581a9d98ff796d973 and project 15d95b0cae244d99885be229335ea541. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:13:30.006276 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-212db45e-f37c-484f-ae2f-5ea034b092f6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:13:30.011857 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-212db45e-f37c-484f-ae2f-5ea034b092f6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67874ac7-fac8-4d6d-9cd1-9091ecb957b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:13:30.111638 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-212db45e-f37c-484f-ae2f-5ea034b092f6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.094717 Jul 11 14:13:30.112477 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 7/21] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:13:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:13:30.135023 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-798a7da4-d303-4979-b065-587d2d99ed32 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:30.140389 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-798a7da4-d303-4979-b065-587d2d99ed32 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:30.529674 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-798a7da4-d303-4979-b065-587d2d99ed32 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:30.588783 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-798a7da4-d303-4979-b065-587d2d99ed32 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1221 microversion: 2.1 time: 0.467315 Jul 11 14:13:30.593579 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 8/22] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:30 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1221 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:31.280445 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-baeeef2d-dc63-4661-8853-c429c2642d19 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Action: 'create', calling method: .version_select at 0x7fc97c147820>, body: {"keypair": {"name": "tempest-keypair-664534556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGHZ0glC8E9kj1611HCk8gGAZWLr+4fC72iHPWW+MW3pb5r0qPZ31YMh7Bjrt85RjgSwuRH2BAL/704wxfUJ6Vtbyjxeq56fvGo2nlAUYo9Rnt/LJQLxRaTWSc0qKGPKg=="}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:31.353288 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-baeeef2d-dc63-4661-8853-c429c2642d19 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Getting quotas for project 15ad9d19847049c18d3bdc9f6e6c5168. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:13:31.365612 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-baeeef2d-dc63-4661-8853-c429c2642d19 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Getting quotas for user 79023e778baa45888e6ef870499e5ad8 and project 15ad9d19847049c18d3bdc9f6e6c5168. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:13:31.459804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-baeeef2d-dc63-4661-8853-c429c2642d19 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.862983 Jul 11 14:13:31.465171 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 9/23] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 11 14:13:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:31.608527 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0a17edcd-ae4c-4feb-b312-cc4c1ca984f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:31.609461 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0a17edcd-ae4c-4feb-b312-cc4c1ca984f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:31.970008 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0a17edcd-ae4c-4feb-b312-cc4c1ca984f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:31.980561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0a17edcd-ae4c-4feb-b312-cc4c1ca984f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1221 microversion: 2.1 time: 0.376935 Jul 11 14:13:31.987634 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 10/24] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:31 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1221 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:32.825877 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-26c5ab27-f90b-43a4-b7f2-c10868d03ae3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:13:32.827201 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-26c5ab27-f90b-43a4-b7f2-c10868d03ae3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:13:32.828917 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-26c5ab27-f90b-43a4-b7f2-c10868d03ae3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:13:32.829685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-26c5ab27-f90b-43a4-b7f2-c10868d03ae3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:13:32.830371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-26c5ab27-f90b-43a4-b7f2-c10868d03ae3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:13:32.882676 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26c5ab27-f90b-43a4-b7f2-c10868d03ae3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:32.886835 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26c5ab27-f90b-43a4-b7f2-c10868d03ae3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:32.887980 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26c5ab27-f90b-43a4-b7f2-c10868d03ae3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:32.893277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26c5ab27-f90b-43a4-b7f2-c10868d03ae3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:32.960783 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-26c5ab27-f90b-43a4-b7f2-c10868d03ae3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Getting quotas for project 76680cc3cbbf45328e05bee398de20de. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:13:32.978186 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-26c5ab27-f90b-43a4-b7f2-c10868d03ae3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Getting quotas for user 75f62561a96f471b9dcc660e7aa9ff60 and project 76680cc3cbbf45328e05bee398de20de. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:13:33.003259 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8d97dd4c-e49d-4d7e-b7e7-5617d5ec1999 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:33.005197 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8d97dd4c-e49d-4d7e-b7e7-5617d5ec1999 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:33.022390 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d97dd4c-e49d-4d7e-b7e7-5617d5ec1999 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:33.027862 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d97dd4c-e49d-4d7e-b7e7-5617d5ec1999 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:33.029091 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d97dd4c-e49d-4d7e-b7e7-5617d5ec1999 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:33.033332 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-26c5ab27-f90b-43a4-b7f2-c10868d03ae3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:13:33.034090 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d97dd4c-e49d-4d7e-b7e7-5617d5ec1999 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:33.048789 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-26c5ab27-f90b-43a4-b7f2-c10868d03ae3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67874ac7-fac8-4d6d-9cd1-9091ecb957b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:13:33.308777 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-26c5ab27-f90b-43a4-b7f2-c10868d03ae3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.836748 Jul 11 14:13:33.317472 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 15/25] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:13:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 4852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 11 14:13:33.341134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0e8e2f36-9841-43af-9379-52d79f068708 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:33.343816 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0e8e2f36-9841-43af-9379-52d79f068708 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:33.662231 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0e8e2f36-9841-43af-9379-52d79f068708 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:33.692609 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0e8e2f36-9841-43af-9379-52d79f068708 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1214 microversion: 2.1 time: 0.367918 Jul 11 14:13:33.693291 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 16/26] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:33 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1214 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:34.713171 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c00ecc07-8a0f-46f6-9e8e-fe2c06a084ce tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:34.713851 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c00ecc07-8a0f-46f6-9e8e-fe2c06a084ce tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:34.729608 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c00ecc07-8a0f-46f6-9e8e-fe2c06a084ce tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:34.740073 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c00ecc07-8a0f-46f6-9e8e-fe2c06a084ce tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:34.744152 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c00ecc07-8a0f-46f6-9e8e-fe2c06a084ce tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:34.746391 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c00ecc07-8a0f-46f6-9e8e-fe2c06a084ce tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:34.831608 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8d97dd4c-e49d-4d7e-b7e7-5617d5ec1999 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:34.854946 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8d97dd4c-e49d-4d7e-b7e7-5617d5ec1999 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1273 microversion: 2.1 time: 1.855413 Jul 11 14:13:34.875804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 11/27] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:32 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1273 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:35.310213 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c00ecc07-8a0f-46f6-9e8e-fe2c06a084ce tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:35.328487 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c00ecc07-8a0f-46f6-9e8e-fe2c06a084ce tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1210 microversion: 2.1 time: 0.620338 Jul 11 14:13:35.346502 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 17/28] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:34 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1210 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:35.884765 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d665fbb3-e02f-49d7-a459-bd575d2b0f96 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:35.885903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d665fbb3-e02f-49d7-a459-bd575d2b0f96 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:35.913816 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d665fbb3-e02f-49d7-a459-bd575d2b0f96 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:35.914320 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d665fbb3-e02f-49d7-a459-bd575d2b0f96 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:35.915108 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d665fbb3-e02f-49d7-a459-bd575d2b0f96 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:35.915540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d665fbb3-e02f-49d7-a459-bd575d2b0f96 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:36.353985 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bd745e3c-1c7c-4498-a133-cc5d8098c8f6 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:36.354619 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bd745e3c-1c7c-4498-a133-cc5d8098c8f6 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:36.376251 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd745e3c-1c7c-4498-a133-cc5d8098c8f6 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:36.385091 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd745e3c-1c7c-4498-a133-cc5d8098c8f6 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:36.385958 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd745e3c-1c7c-4498-a133-cc5d8098c8f6 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:36.386593 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd745e3c-1c7c-4498-a133-cc5d8098c8f6 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:36.407132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d665fbb3-e02f-49d7-a459-bd575d2b0f96 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:36.424440 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d665fbb3-e02f-49d7-a459-bd575d2b0f96 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1279 microversion: 2.1 time: 0.544327 Jul 11 14:13:36.441019 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 12/29] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:35 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1279 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:36.785450 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd745e3c-1c7c-4498-a133-cc5d8098c8f6 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:36.800815 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bd745e3c-1c7c-4498-a133-cc5d8098c8f6 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1266 microversion: 2.1 time: 0.451480 Jul 11 14:13:36.801572 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 18/30] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:36 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1266 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:37.443076 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-96f1a7db-5a0c-41dc-8f1a-837fe492b738 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:37.444464 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-96f1a7db-5a0c-41dc-8f1a-837fe492b738 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:37.453211 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-96f1a7db-5a0c-41dc-8f1a-837fe492b738 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:37.464063 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-96f1a7db-5a0c-41dc-8f1a-837fe492b738 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:37.486542 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-96f1a7db-5a0c-41dc-8f1a-837fe492b738 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:37.487086 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-96f1a7db-5a0c-41dc-8f1a-837fe492b738 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:37.821608 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c0a2a879-322f-4684-8f29-60762bce0f1e tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:37.822991 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c0a2a879-322f-4684-8f29-60762bce0f1e tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:37.856011 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0a2a879-322f-4684-8f29-60762bce0f1e tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:37.856735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0a2a879-322f-4684-8f29-60762bce0f1e tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:37.857696 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0a2a879-322f-4684-8f29-60762bce0f1e tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:37.858341 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0a2a879-322f-4684-8f29-60762bce0f1e tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:37.942525 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-96f1a7db-5a0c-41dc-8f1a-837fe492b738 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:37.951817 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-96f1a7db-5a0c-41dc-8f1a-837fe492b738 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1279 microversion: 2.1 time: 0.512384 Jul 11 14:13:37.952194 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 13/31] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:37 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1279 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:38.316402 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c0a2a879-322f-4684-8f29-60762bce0f1e tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:38.331392 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c0a2a879-322f-4684-8f29-60762bce0f1e tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1272 microversion: 2.1 time: 0.515156 Jul 11 14:13:38.334572 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 19/32] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:37 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1272 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:38.973421 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2ed081fd-ea92-4a66-be01-17e721ead88c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:38.974582 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2ed081fd-ea92-4a66-be01-17e721ead88c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:39.021892 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ed081fd-ea92-4a66-be01-17e721ead88c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:39.023916 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ed081fd-ea92-4a66-be01-17e721ead88c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:39.029773 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ed081fd-ea92-4a66-be01-17e721ead88c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:39.031057 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ed081fd-ea92-4a66-be01-17e721ead88c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:39.356730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f5e94106-ba2d-45fe-9ab3-3f7fbc78fa4f tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:39.358832 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f5e94106-ba2d-45fe-9ab3-3f7fbc78fa4f tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:39.411451 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5e94106-ba2d-45fe-9ab3-3f7fbc78fa4f tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:39.422302 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5e94106-ba2d-45fe-9ab3-3f7fbc78fa4f tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:39.426919 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5e94106-ba2d-45fe-9ab3-3f7fbc78fa4f tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:39.430119 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5e94106-ba2d-45fe-9ab3-3f7fbc78fa4f tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:39.927880 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=4 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:39.955967 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f5e94106-ba2d-45fe-9ab3-3f7fbc78fa4f tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:39.986420 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f5e94106-ba2d-45fe-9ab3-3f7fbc78fa4f tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1272 microversion: 2.1 time: 0.631441 Jul 11 14:13:40.005090 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 20/33] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:39 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1272 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:41.010708 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-422fa00d-1195-46ae-8379-1d140ce2f10b tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:41.011364 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-422fa00d-1195-46ae-8379-1d140ce2f10b tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:41.029785 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-422fa00d-1195-46ae-8379-1d140ce2f10b tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:41.030272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-422fa00d-1195-46ae-8379-1d140ce2f10b tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:41.031060 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-422fa00d-1195-46ae-8379-1d140ce2f10b tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:41.031501 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-422fa00d-1195-46ae-8379-1d140ce2f10b tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:41.589277 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2ed081fd-ea92-4a66-be01-17e721ead88c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:41.601172 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2ed081fd-ea92-4a66-be01-17e721ead88c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 2.636461 Jul 11 14:13:41.602367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 14/34] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:38 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 2638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:41.681883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-422fa00d-1195-46ae-8379-1d140ce2f10b tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:41.706510 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-422fa00d-1195-46ae-8379-1d140ce2f10b tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.695554 Jul 11 14:13:41.717665 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 21/35] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:41 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:42.619501 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c1bf26b8-23b7-4ede-8288-4eb52c773b58 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:42.620898 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c1bf26b8-23b7-4ede-8288-4eb52c773b58 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:42.623148 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=20 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:42.638365 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c1bf26b8-23b7-4ede-8288-4eb52c773b58 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:42.639162 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c1bf26b8-23b7-4ede-8288-4eb52c773b58 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:42.643587 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c1bf26b8-23b7-4ede-8288-4eb52c773b58 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:42.644530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c1bf26b8-23b7-4ede-8288-4eb52c773b58 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:42.727223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d8c40d4a-43e4-4080-8982-e0c43125e4ab tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:42.728014 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d8c40d4a-43e4-4080-8982-e0c43125e4ab tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:42.753098 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8c40d4a-43e4-4080-8982-e0c43125e4ab tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:42.753845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8c40d4a-43e4-4080-8982-e0c43125e4ab tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:42.756753 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8c40d4a-43e4-4080-8982-e0c43125e4ab tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:42.758777 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8c40d4a-43e4-4080-8982-e0c43125e4ab tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:42.922312 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:43.458644 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c1bf26b8-23b7-4ede-8288-4eb52c773b58 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:43.468500 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c1bf26b8-23b7-4ede-8288-4eb52c773b58 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.853551 Jul 11 14:13:43.471532 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 15/36] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:42 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:43.685037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=10 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:43.930657 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d8c40d4a-43e4-4080-8982-e0c43125e4ab tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:43.946430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d8c40d4a-43e4-4080-8982-e0c43125e4ab tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 1.224691 Jul 11 14:13:43.949371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 22/37] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:42 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:44.489202 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2beab4c7-26c6-4418-915b-583747ff1d35 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:44.490046 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2beab4c7-26c6-4418-915b-583747ff1d35 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:44.492987 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=7 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:44.505092 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2beab4c7-26c6-4418-915b-583747ff1d35 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:44.507407 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2beab4c7-26c6-4418-915b-583747ff1d35 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:44.520013 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2beab4c7-26c6-4418-915b-583747ff1d35 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:44.520693 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2beab4c7-26c6-4418-915b-583747ff1d35 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:44.968442 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-669828e6-306e-471a-949d-b082d7d872d4 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:44.969143 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-669828e6-306e-471a-949d-b082d7d872d4 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:44.989857 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-669828e6-306e-471a-949d-b082d7d872d4 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:44.991941 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-669828e6-306e-471a-949d-b082d7d872d4 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:44.993428 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-669828e6-306e-471a-949d-b082d7d872d4 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:44.995053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-669828e6-306e-471a-949d-b082d7d872d4 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:45.912397 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2beab4c7-26c6-4418-915b-583747ff1d35 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:45.920131 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-669828e6-306e-471a-949d-b082d7d872d4 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:45.935301 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-669828e6-306e-471a-949d-b082d7d872d4 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.971198 Jul 11 14:13:45.938733 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2beab4c7-26c6-4418-915b-583747ff1d35 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 1.453098 Jul 11 14:13:45.950090 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 16/38] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:44 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:45.950316 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 23/39] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:44 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:46.957740 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-20e4b264-de4a-4b69-9fc1-42bcfc5dbccf tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:46.959138 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-20e4b264-de4a-4b69-9fc1-42bcfc5dbccf tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:46.959802 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aff5e366-8f11-4f1d-b3c2-9a311157b33e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:46.960425 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aff5e366-8f11-4f1d-b3c2-9a311157b33e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:46.971001 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aff5e366-8f11-4f1d-b3c2-9a311157b33e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:46.973395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aff5e366-8f11-4f1d-b3c2-9a311157b33e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:46.978341 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aff5e366-8f11-4f1d-b3c2-9a311157b33e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:46.981029 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aff5e366-8f11-4f1d-b3c2-9a311157b33e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:46.984115 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20e4b264-de4a-4b69-9fc1-42bcfc5dbccf tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:46.986294 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20e4b264-de4a-4b69-9fc1-42bcfc5dbccf tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:46.988583 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20e4b264-de4a-4b69-9fc1-42bcfc5dbccf tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:46.989236 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20e4b264-de4a-4b69-9fc1-42bcfc5dbccf tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:47.435504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-20e4b264-de4a-4b69-9fc1-42bcfc5dbccf tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:47.449008 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-20e4b264-de4a-4b69-9fc1-42bcfc5dbccf tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.495807 Jul 11 14:13:47.470736 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 17/40] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:46 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:47.478799 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5a59dba0-8a1d-44ec-81bc-4c109bc628e3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-311982626", "imageRef": "67874ac7-fac8-4d6d-9cd1-9091ecb957b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "157161e1-a50b-44c4-82a7-27bca4094b73"}], "security_groups": [{"name": "tempest-securitygroup--117713951"}], "key_name": "tempest-keypair-664534556", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:47.499073 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aff5e366-8f11-4f1d-b3c2-9a311157b33e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:47.518523 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aff5e366-8f11-4f1d-b3c2-9a311157b33e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.562462 Jul 11 14:13:47.528135 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 24/41] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:46 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:47.857927 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-5a59dba0-8a1d-44ec-81bc-4c109bc628e3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] validate_networks() for [('157161e1-a50b-44c4-82a7-27bca4094b73', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:13:48.021538 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-45be295f-278f-4324-b421-d5005598b902 req-02382868-985b-409b-856f-04bde8f2b409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da6649c5-69b0-4e1f-992c-62f13a87ea6d", "tag": "4fdd29a5-a920-4c2e-933f-1853719c86d8"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:48.052683 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-45be295f-278f-4324-b421-d5005598b902 req-02382868-985b-409b-856f-04bde8f2b409 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:48.059434 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-45be295f-278f-4324-b421-d5005598b902 req-02382868-985b-409b-856f-04bde8f2b409 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:48.097840 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-45be295f-278f-4324-b421-d5005598b902 req-02382868-985b-409b-856f-04bde8f2b409 service nova] Creating event network-changed:4fdd29a5-a920-4c2e-933f-1853719c86d8 for instance da6649c5-69b0-4e1f-992c-62f13a87ea6d on hv-cinder-81914 Jul 11 14:13:48.098289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-45be295f-278f-4324-b421-d5005598b902 req-02382868-985b-409b-856f-04bde8f2b409 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 11 14:13:48.099875 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b5c09f9-db3f-4502-b8d6-9da8a9ed2209 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:48.100322 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b5c09f9-db3f-4502-b8d6-9da8a9ed2209 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:48.101736 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b5c09f9-db3f-4502-b8d6-9da8a9ed2209 None None] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:48.103487 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b5c09f9-db3f-4502-b8d6-9da8a9ed2209 None None] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:48.121331 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.compute.rpcapi [None req-6b5c09f9-db3f-4502-b8d6-9da8a9ed2209 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 11 14:13:48.122964 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b5c09f9-db3f-4502-b8d6-9da8a9ed2209 None None] Releasing lock "compute-rpcapi-router" {{(pid=117920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 11 14:13:48.158055 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6b5c09f9-db3f-4502-b8d6-9da8a9ed2209 None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.628240 Jul 11 14:13:48.159124 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 25/42] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:48.957972 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-d064de6a-c9f4-4509-990a-6dd75cf1646d req-a01c9894-445a-46bc-bacc-56773d895885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce9c0371-22ec-432a-9835-696bc61b05de", "tag": "cc6828e4-dd29-4d09-af39-cc7013ef4ce3"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:48.992299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d064de6a-c9f4-4509-990a-6dd75cf1646d req-a01c9894-445a-46bc-bacc-56773d895885 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:48.994580 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d064de6a-c9f4-4509-990a-6dd75cf1646d req-a01c9894-445a-46bc-bacc-56773d895885 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:49.034610 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-d064de6a-c9f4-4509-990a-6dd75cf1646d req-a01c9894-445a-46bc-bacc-56773d895885 service nova] Creating event network-changed:cc6828e4-dd29-4d09-af39-cc7013ef4ce3 for instance ce9c0371-22ec-432a-9835-696bc61b05de on hv-cinder-81914 Jul 11 14:13:49.054309 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-d064de6a-c9f4-4509-990a-6dd75cf1646d req-a01c9894-445a-46bc-bacc-56773d895885 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.629937 Jul 11 14:13:49.056804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-5a59dba0-8a1d-44ec-81bc-4c109bc628e3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:13:49.057316 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-5a59dba0-8a1d-44ec-81bc-4c109bc628e3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:13:49.057802 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-5a59dba0-8a1d-44ec-81bc-4c109bc628e3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:13:49.058065 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 26/43] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:13:49.058423 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-5a59dba0-8a1d-44ec-81bc-4c109bc628e3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:13:49.058855 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-5a59dba0-8a1d-44ec-81bc-4c109bc628e3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:13:49.071821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b54ace27-a072-46e4-b977-9f42666bae07 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:49.073972 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b54ace27-a072-46e4-b977-9f42666bae07 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:49.075727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5a59dba0-8a1d-44ec-81bc-4c109bc628e3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:49.076175 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5a59dba0-8a1d-44ec-81bc-4c109bc628e3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:49.077013 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5a59dba0-8a1d-44ec-81bc-4c109bc628e3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:49.077450 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5a59dba0-8a1d-44ec-81bc-4c109bc628e3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:49.082120 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b54ace27-a072-46e4-b977-9f42666bae07 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:49.082637 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b54ace27-a072-46e4-b977-9f42666bae07 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:49.083765 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b54ace27-a072-46e4-b977-9f42666bae07 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:49.084358 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b54ace27-a072-46e4-b977-9f42666bae07 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:49.139517 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-5a59dba0-8a1d-44ec-81bc-4c109bc628e3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Getting quotas for project 15ad9d19847049c18d3bdc9f6e6c5168. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:13:49.163178 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-5a59dba0-8a1d-44ec-81bc-4c109bc628e3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Getting quotas for user 79023e778baa45888e6ef870499e5ad8 and project 15ad9d19847049c18d3bdc9f6e6c5168. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:13:49.184290 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5a59dba0-8a1d-44ec-81bc-4c109bc628e3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:13:49.187527 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5a59dba0-8a1d-44ec-81bc-4c109bc628e3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67874ac7-fac8-4d6d-9cd1-9091ecb957b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:13:49.250056 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5a59dba0-8a1d-44ec-81bc-4c109bc628e3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.776959 Jul 11 14:13:49.252313 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 18/44] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:13:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:13:49.264677 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f798eef6-4a61-44c4-8285-7bf074d49b4c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:49.266033 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f798eef6-4a61-44c4-8285-7bf074d49b4c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:49.277618 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f798eef6-4a61-44c4-8285-7bf074d49b4c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:49.278288 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f798eef6-4a61-44c4-8285-7bf074d49b4c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:49.280175 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f798eef6-4a61-44c4-8285-7bf074d49b4c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:49.280778 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f798eef6-4a61-44c4-8285-7bf074d49b4c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:49.316107 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b54ace27-a072-46e4-b977-9f42666bae07 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:49.330291 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b54ace27-a072-46e4-b977-9f42666bae07 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.270144 Jul 11 14:13:49.330892 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 27/45] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:49 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:49.362720 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-77330211-06ed-45f3-b455-bd81a0cba94a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:49.363682 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-77330211-06ed-45f3-b455-bd81a0cba94a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:49.498891 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-77330211-06ed-45f3-b455-bd81a0cba94a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:49.506185 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-77330211-06ed-45f3-b455-bd81a0cba94a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1236 microversion: 2.1 time: 0.151338 Jul 11 14:13:49.507270 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 28/46] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:49 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1236 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:49.513534 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f798eef6-4a61-44c4-8285-7bf074d49b4c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:49.529105 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f798eef6-4a61-44c4-8285-7bf074d49b4c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.271812 Jul 11 14:13:49.531111 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 19/47] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:49 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:50.262348 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-7beb12e7-41d9-4791-aee4-15127309d2ea req-bf3fb2b3-8c0c-4f54-b834-80e386797f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b6aebc-3e65-4609-a344-61462c14e25d", "tag": "5f3f18ed-2057-426c-9899-844263690d4b"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:50.278844 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7beb12e7-41d9-4791-aee4-15127309d2ea req-bf3fb2b3-8c0c-4f54-b834-80e386797f65 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:50.279292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7beb12e7-41d9-4791-aee4-15127309d2ea req-bf3fb2b3-8c0c-4f54-b834-80e386797f65 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:50.311071 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-7beb12e7-41d9-4791-aee4-15127309d2ea req-bf3fb2b3-8c0c-4f54-b834-80e386797f65 service nova] Creating event network-changed:5f3f18ed-2057-426c-9899-844263690d4b for instance a7b6aebc-3e65-4609-a344-61462c14e25d on hv-cinder-81914 Jul 11 14:13:50.321433 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-7beb12e7-41d9-4791-aee4-15127309d2ea req-bf3fb2b3-8c0c-4f54-b834-80e386797f65 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062470 Jul 11 14:13:50.323545 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 29/48] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:50.351384 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-eb642141-7ac1-45bd-a549-a0020f942d40 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:50.351959 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-eb642141-7ac1-45bd-a549-a0020f942d40 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:50.368741 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb642141-7ac1-45bd-a549-a0020f942d40 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:50.369632 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb642141-7ac1-45bd-a549-a0020f942d40 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:50.372282 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb642141-7ac1-45bd-a549-a0020f942d40 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:50.373262 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb642141-7ac1-45bd-a549-a0020f942d40 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:50.527090 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-697afb16-d46b-47f9-af7d-152964f04c67 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:50.527989 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-697afb16-d46b-47f9-af7d-152964f04c67 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:50.541175 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-697afb16-d46b-47f9-af7d-152964f04c67 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:50.541852 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-697afb16-d46b-47f9-af7d-152964f04c67 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:50.544097 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-697afb16-d46b-47f9-af7d-152964f04c67 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:50.544698 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-697afb16-d46b-47f9-af7d-152964f04c67 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:50.603959 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-eb642141-7ac1-45bd-a549-a0020f942d40 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:50.615657 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-eb642141-7ac1-45bd-a549-a0020f942d40 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.271666 Jul 11 14:13:50.617589 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 20/49] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:50 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:50.629818 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1ea58f24-8b38-4261-8d54-76dbef987381 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:50.632656 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1ea58f24-8b38-4261-8d54-76dbef987381 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:50.646950 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-697afb16-d46b-47f9-af7d-152964f04c67 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:50.648916 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1ea58f24-8b38-4261-8d54-76dbef987381 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:50.649385 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1ea58f24-8b38-4261-8d54-76dbef987381 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:50.650284 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1ea58f24-8b38-4261-8d54-76dbef987381 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:50.652099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1ea58f24-8b38-4261-8d54-76dbef987381 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:50.661399 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-697afb16-d46b-47f9-af7d-152964f04c67 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1240 microversion: 2.1 time: 0.139194 Jul 11 14:13:50.670692 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 30/50] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:50 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1240 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:50.827127 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1ea58f24-8b38-4261-8d54-76dbef987381 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:50.836706 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1ea58f24-8b38-4261-8d54-76dbef987381 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.217170 Jul 11 14:13:50.837504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 21/51] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:50 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:51.638879 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c9885786-5d9d-4323-8186-281b4737ddf4 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:51.639754 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c9885786-5d9d-4323-8186-281b4737ddf4 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:51.647579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9885786-5d9d-4323-8186-281b4737ddf4 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:51.648623 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9885786-5d9d-4323-8186-281b4737ddf4 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:51.649733 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9885786-5d9d-4323-8186-281b4737ddf4 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:51.650429 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9885786-5d9d-4323-8186-281b4737ddf4 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:51.680510 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-838f113c-68dc-455a-9d8f-b2112ed73de5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:51.681287 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-838f113c-68dc-455a-9d8f-b2112ed73de5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:51.691542 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-838f113c-68dc-455a-9d8f-b2112ed73de5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:51.694144 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-838f113c-68dc-455a-9d8f-b2112ed73de5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:51.695040 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-838f113c-68dc-455a-9d8f-b2112ed73de5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:51.695490 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-838f113c-68dc-455a-9d8f-b2112ed73de5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:51.784621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-838f113c-68dc-455a-9d8f-b2112ed73de5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:51.794764 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-838f113c-68dc-455a-9d8f-b2112ed73de5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1240 microversion: 2.1 time: 0.118633 Jul 11 14:13:51.797539 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 22/52] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:51 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1240 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:51.839276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c9885786-5d9d-4323-8186-281b4737ddf4 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:51.850149 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c9885786-5d9d-4323-8186-281b4737ddf4 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.219117 Jul 11 14:13:51.851882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 31/53] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:51 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:51.854017 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c1c08bcd-a194-486d-b002-f684e2e713e6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:51.854744 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c1c08bcd-a194-486d-b002-f684e2e713e6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:51.863884 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c1c08bcd-a194-486d-b002-f684e2e713e6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:51.864339 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c1c08bcd-a194-486d-b002-f684e2e713e6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:51.866927 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c1c08bcd-a194-486d-b002-f684e2e713e6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:51.866927 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c1c08bcd-a194-486d-b002-f684e2e713e6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:52.079824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c1c08bcd-a194-486d-b002-f684e2e713e6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:52.091470 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c1c08bcd-a194-486d-b002-f684e2e713e6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.241735 Jul 11 14:13:52.093999 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 23/54] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:51 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:52.818844 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7f9b0a0e-08bd-4c0d-a78d-dece85cc23bc tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:52.821425 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7f9b0a0e-08bd-4c0d-a78d-dece85cc23bc tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:52.836191 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7f9b0a0e-08bd-4c0d-a78d-dece85cc23bc tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:52.836756 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7f9b0a0e-08bd-4c0d-a78d-dece85cc23bc tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:52.837746 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7f9b0a0e-08bd-4c0d-a78d-dece85cc23bc tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:52.838184 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7f9b0a0e-08bd-4c0d-a78d-dece85cc23bc tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:52.869403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1d6bb663-9d89-4fad-889e-86230e36f133 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:52.870676 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1d6bb663-9d89-4fad-889e-86230e36f133 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:52.910077 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1d6bb663-9d89-4fad-889e-86230e36f133 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:52.910579 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1d6bb663-9d89-4fad-889e-86230e36f133 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:52.932210 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1d6bb663-9d89-4fad-889e-86230e36f133 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:52.933718 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1d6bb663-9d89-4fad-889e-86230e36f133 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:53.155433 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7f9b0a0e-08bd-4c0d-a78d-dece85cc23bc tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:53.174221 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7f9b0a0e-08bd-4c0d-a78d-dece85cc23bc tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1288 microversion: 2.1 time: 0.352854 Jul 11 14:13:53.179944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 32/55] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:52 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1288 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:53.196271 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6dde2fe9-ec17-4e44-8a3b-0798193c4979 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:53.207271 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6dde2fe9-ec17-4e44-8a3b-0798193c4979 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:53.235688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dde2fe9-ec17-4e44-8a3b-0798193c4979 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:53.237579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dde2fe9-ec17-4e44-8a3b-0798193c4979 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:53.239823 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dde2fe9-ec17-4e44-8a3b-0798193c4979 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:53.243658 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dde2fe9-ec17-4e44-8a3b-0798193c4979 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:53.746803 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6dde2fe9-ec17-4e44-8a3b-0798193c4979 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:53.749990 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1d6bb663-9d89-4fad-889e-86230e36f133 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:53.754101 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=83 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:53.756300 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6dde2fe9-ec17-4e44-8a3b-0798193c4979 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.573690 Jul 11 14:13:53.760622 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 33/56] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:53 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:53.772111 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1d6bb663-9d89-4fad-889e-86230e36f133 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.907276 Jul 11 14:13:53.773759 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 24/57] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:52 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:54.198747 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-781b54c1-a57b-47a2-b9ee-89fa2a015598 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:54.199322 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-781b54c1-a57b-47a2-b9ee-89fa2a015598 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:54.206852 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-781b54c1-a57b-47a2-b9ee-89fa2a015598 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:54.207303 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-781b54c1-a57b-47a2-b9ee-89fa2a015598 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:54.208058 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-781b54c1-a57b-47a2-b9ee-89fa2a015598 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:54.208663 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-781b54c1-a57b-47a2-b9ee-89fa2a015598 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:54.309315 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-781b54c1-a57b-47a2-b9ee-89fa2a015598 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:54.317219 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-781b54c1-a57b-47a2-b9ee-89fa2a015598 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1294 microversion: 2.1 time: 0.124189 Jul 11 14:13:54.326524 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 34/58] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:54 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1294 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:54.775367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e10d32a5-411c-42d0-b130-de46b2050285 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:54.776069 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e10d32a5-411c-42d0-b130-de46b2050285 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:54.794145 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-33912508-54cd-4165-94dc-3dd68dcfdcfc tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:54.794674 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e10d32a5-411c-42d0-b130-de46b2050285 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:54.795124 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e10d32a5-411c-42d0-b130-de46b2050285 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:54.795788 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-33912508-54cd-4165-94dc-3dd68dcfdcfc tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:54.795902 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e10d32a5-411c-42d0-b130-de46b2050285 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:54.796317 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e10d32a5-411c-42d0-b130-de46b2050285 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:54.807285 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33912508-54cd-4165-94dc-3dd68dcfdcfc tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:54.810356 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33912508-54cd-4165-94dc-3dd68dcfdcfc tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:54.811637 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33912508-54cd-4165-94dc-3dd68dcfdcfc tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:54.813961 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33912508-54cd-4165-94dc-3dd68dcfdcfc tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:55.043421 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-33912508-54cd-4165-94dc-3dd68dcfdcfc tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:55.048714 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:55.054932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-33912508-54cd-4165-94dc-3dd68dcfdcfc tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.265340 Jul 11 14:13:55.056311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 35/59] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:54 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:55.068581 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e10d32a5-411c-42d0-b130-de46b2050285 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:55.077856 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e10d32a5-411c-42d0-b130-de46b2050285 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.306977 Jul 11 14:13:55.078723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 25/60] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:54 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:55.335902 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-677a0bce-0146-4bea-b893-1a3ad69a3bc0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:55.336778 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-677a0bce-0146-4bea-b893-1a3ad69a3bc0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:55.342666 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-677a0bce-0146-4bea-b893-1a3ad69a3bc0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:55.343101 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-677a0bce-0146-4bea-b893-1a3ad69a3bc0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:55.343887 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-677a0bce-0146-4bea-b893-1a3ad69a3bc0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:55.344307 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-677a0bce-0146-4bea-b893-1a3ad69a3bc0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:55.425166 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-677a0bce-0146-4bea-b893-1a3ad69a3bc0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:55.435144 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-677a0bce-0146-4bea-b893-1a3ad69a3bc0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1294 microversion: 2.1 time: 0.103856 Jul 11 14:13:55.439299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 36/61] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:55 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1294 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:56.076558 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4bc57de2-5940-4151-b427-b2c2ebdbe453 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:56.077180 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4bc57de2-5940-4151-b427-b2c2ebdbe453 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:56.083497 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4bc57de2-5940-4151-b427-b2c2ebdbe453 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:56.084170 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4bc57de2-5940-4151-b427-b2c2ebdbe453 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:56.084970 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4bc57de2-5940-4151-b427-b2c2ebdbe453 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:56.085419 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4bc57de2-5940-4151-b427-b2c2ebdbe453 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:56.094113 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7a96178f-fc81-4ca5-9fbc-5dd9cd394f9f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:56.094694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7a96178f-fc81-4ca5-9fbc-5dd9cd394f9f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:56.103037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a96178f-fc81-4ca5-9fbc-5dd9cd394f9f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:56.105705 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a96178f-fc81-4ca5-9fbc-5dd9cd394f9f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:56.106632 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a96178f-fc81-4ca5-9fbc-5dd9cd394f9f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:56.108121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a96178f-fc81-4ca5-9fbc-5dd9cd394f9f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:56.259462 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4bc57de2-5940-4151-b427-b2c2ebdbe453 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:56.273617 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4bc57de2-5940-4151-b427-b2c2ebdbe453 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.204379 Jul 11 14:13:56.274633 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 26/62] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:56 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:56.394098 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7a96178f-fc81-4ca5-9fbc-5dd9cd394f9f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:56.412201 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7a96178f-fc81-4ca5-9fbc-5dd9cd394f9f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.320807 Jul 11 14:13:56.425210 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 37/63] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:56 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:56.463718 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-29bf5efb-d5f6-4271-af32-71622b0cd80f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:56.465426 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-29bf5efb-d5f6-4271-af32-71622b0cd80f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:56.487302 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29bf5efb-d5f6-4271-af32-71622b0cd80f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:56.487818 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29bf5efb-d5f6-4271-af32-71622b0cd80f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:56.488878 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29bf5efb-d5f6-4271-af32-71622b0cd80f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:56.489538 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29bf5efb-d5f6-4271-af32-71622b0cd80f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:56.672104 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-29bf5efb-d5f6-4271-af32-71622b0cd80f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:56.688100 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-29bf5efb-d5f6-4271-af32-71622b0cd80f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1294 microversion: 2.1 time: 0.235451 Jul 11 14:13:56.689153 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 27/64] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:56 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1294 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:57.291753 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dae6a411-cb21-4d4d-b813-2fb77ca40c46 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:57.292577 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dae6a411-cb21-4d4d-b813-2fb77ca40c46 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:57.294622 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:57.300018 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dae6a411-cb21-4d4d-b813-2fb77ca40c46 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:57.300461 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dae6a411-cb21-4d4d-b813-2fb77ca40c46 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:57.301282 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dae6a411-cb21-4d4d-b813-2fb77ca40c46 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:57.301733 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dae6a411-cb21-4d4d-b813-2fb77ca40c46 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:57.443057 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ecb368f6-9184-43b9-afb7-09b8acad8e81 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:57.443760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ecb368f6-9184-43b9-afb7-09b8acad8e81 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:57.465091 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ecb368f6-9184-43b9-afb7-09b8acad8e81 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:57.465519 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ecb368f6-9184-43b9-afb7-09b8acad8e81 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:57.475040 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ecb368f6-9184-43b9-afb7-09b8acad8e81 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:57.478717 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ecb368f6-9184-43b9-afb7-09b8acad8e81 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:57.696873 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dae6a411-cb21-4d4d-b813-2fb77ca40c46 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:57.711206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dae6a411-cb21-4d4d-b813-2fb77ca40c46 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.422874 Jul 11 14:13:57.711933 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 38/65] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:57 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:57.722254 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9c1d3b07-08b9-4dc4-99f7-7599da130277 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:57.722982 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9c1d3b07-08b9-4dc4-99f7-7599da130277 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:57.733629 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9c1d3b07-08b9-4dc4-99f7-7599da130277 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:57.737830 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9c1d3b07-08b9-4dc4-99f7-7599da130277 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:57.739026 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9c1d3b07-08b9-4dc4-99f7-7599da130277 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:57.741626 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9c1d3b07-08b9-4dc4-99f7-7599da130277 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:57.961375 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ecb368f6-9184-43b9-afb7-09b8acad8e81 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:57.973171 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ecb368f6-9184-43b9-afb7-09b8acad8e81 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.536637 Jul 11 14:13:57.984050 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 28/66] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:57 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:58.081613 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9c1d3b07-08b9-4dc4-99f7-7599da130277 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:58.100336 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9c1d3b07-08b9-4dc4-99f7-7599da130277 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.387065 Jul 11 14:13:58.102299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 39/67] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:57 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:58.274078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-787ff882-6c2d-40ae-a4bb-b3b38033f2f4 req-0ce07d0b-aaca-447e-91ea-190a968d7965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9c0371-22ec-432a-9835-696bc61b05de", "name": "network-vif-plugged", "status": "completed", "tag": "cc6828e4-dd29-4d09-af39-cc7013ef4ce3"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:58.296150 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-787ff882-6c2d-40ae-a4bb-b3b38033f2f4 req-0ce07d0b-aaca-447e-91ea-190a968d7965 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:58.301979 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-787ff882-6c2d-40ae-a4bb-b3b38033f2f4 req-0ce07d0b-aaca-447e-91ea-190a968d7965 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:58.355544 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-787ff882-6c2d-40ae-a4bb-b3b38033f2f4 req-0ce07d0b-aaca-447e-91ea-190a968d7965 service nova] Creating event network-vif-plugged:cc6828e4-dd29-4d09-af39-cc7013ef4ce3 for instance ce9c0371-22ec-432a-9835-696bc61b05de on hv-cinder-81914 Jul 11 14:13:58.359240 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-787ff882-6c2d-40ae-a4bb-b3b38033f2f4 req-0ce07d0b-aaca-447e-91ea-190a968d7965 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117921) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 11 14:13:58.363909 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-101fd5ed-27b7-4f2e-8c9a-75c4757cbb2b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:58.364532 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-101fd5ed-27b7-4f2e-8c9a-75c4757cbb2b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:58.366185 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-101fd5ed-27b7-4f2e-8c9a-75c4757cbb2b None None] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:58.367093 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-101fd5ed-27b7-4f2e-8c9a-75c4757cbb2b None None] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:58.378995 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.compute.rpcapi [None req-101fd5ed-27b7-4f2e-8c9a-75c4757cbb2b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 11 14:13:58.378995 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-101fd5ed-27b7-4f2e-8c9a-75c4757cbb2b None None] Releasing lock "compute-rpcapi-router" {{(pid=117921) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 11 14:13:58.400876 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-101fd5ed-27b7-4f2e-8c9a-75c4757cbb2b None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.415212 Jul 11 14:13:58.401797 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 29/68] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:58.729465 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fe18b532-534f-46fa-b783-58be4b8545d3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:58.736749 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fe18b532-534f-46fa-b783-58be4b8545d3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:58.741625 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:58.755398 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe18b532-534f-46fa-b783-58be4b8545d3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:58.755905 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe18b532-534f-46fa-b783-58be4b8545d3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:58.759890 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe18b532-534f-46fa-b783-58be4b8545d3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:58.760410 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe18b532-534f-46fa-b783-58be4b8545d3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:58.993583 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a2c223a7-aa84-403d-af59-204a245745ce tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:58.994856 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a2c223a7-aa84-403d-af59-204a245745ce tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:59.011247 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2c223a7-aa84-403d-af59-204a245745ce tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:59.011856 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2c223a7-aa84-403d-af59-204a245745ce tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:59.013252 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2c223a7-aa84-403d-af59-204a245745ce tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:59.013874 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2c223a7-aa84-403d-af59-204a245745ce tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:59.183281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:59.300764 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fe18b532-534f-46fa-b783-58be4b8545d3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:59.310503 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fe18b532-534f-46fa-b783-58be4b8545d3 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.585139 Jul 11 14:13:59.322650 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 40/69] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:58 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:59.333690 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-23ac9456-bf9a-4673-8e13-62bae2a48e1b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:59.334815 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-23ac9456-bf9a-4673-8e13-62bae2a48e1b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:59.343210 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23ac9456-bf9a-4673-8e13-62bae2a48e1b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:59.343755 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23ac9456-bf9a-4673-8e13-62bae2a48e1b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:59.344675 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23ac9456-bf9a-4673-8e13-62bae2a48e1b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:59.345176 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23ac9456-bf9a-4673-8e13-62bae2a48e1b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:59.346806 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a2c223a7-aa84-403d-af59-204a245745ce tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:59.360115 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a2c223a7-aa84-403d-af59-204a245745ce tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.371114 Jul 11 14:13:59.372031 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 30/70] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:58 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:59.379846 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-a8759764-45fb-4379-bf60-23fd8defe4ac req-1525d0cf-a3e3-4f9c-996a-337e8673d298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f5f00b-3f48-4d27-9330-2b61cfa19d27", "tag": "0b6e7c6b-601e-412f-b987-a5b8f2bb58b7"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:59.404606 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-a8759764-45fb-4379-bf60-23fd8defe4ac req-1525d0cf-a3e3-4f9c-996a-337e8673d298 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:59.405047 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-a8759764-45fb-4379-bf60-23fd8defe4ac req-1525d0cf-a3e3-4f9c-996a-337e8673d298 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:59.416937 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-a8759764-45fb-4379-bf60-23fd8defe4ac req-1525d0cf-a3e3-4f9c-996a-337e8673d298 service nova] Creating event network-changed:0b6e7c6b-601e-412f-b987-a5b8f2bb58b7 for instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 on hv-cinder-81914 Jul 11 14:13:59.422030 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-a8759764-45fb-4379-bf60-23fd8defe4ac req-1525d0cf-a3e3-4f9c-996a-337e8673d298 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045757 Jul 11 14:13:59.422991 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 31/71] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:59.503198 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:59.509539 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-23ac9456-bf9a-4673-8e13-62bae2a48e1b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:59.517196 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-23ac9456-bf9a-4673-8e13-62bae2a48e1b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.192825 Jul 11 14:13:59.517803 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 41/72] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:59 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:00.328523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-40462d8d-e04b-4fd7-85ca-e6fc84cbce01 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:00.329336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-40462d8d-e04b-4fd7-85ca-e6fc84cbce01 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:00.337520 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40462d8d-e04b-4fd7-85ca-e6fc84cbce01 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:00.338050 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40462d8d-e04b-4fd7-85ca-e6fc84cbce01 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:00.338943 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40462d8d-e04b-4fd7-85ca-e6fc84cbce01 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:00.339391 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40462d8d-e04b-4fd7-85ca-e6fc84cbce01 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:00.378790 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-89a8a49f-f815-49b1-9ac1-e5a25835eb13 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:00.379412 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-89a8a49f-f815-49b1-9ac1-e5a25835eb13 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:00.386504 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89a8a49f-f815-49b1-9ac1-e5a25835eb13 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:00.387226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89a8a49f-f815-49b1-9ac1-e5a25835eb13 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:00.388182 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89a8a49f-f815-49b1-9ac1-e5a25835eb13 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:00.388621 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89a8a49f-f815-49b1-9ac1-e5a25835eb13 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:00.483980 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-40462d8d-e04b-4fd7-85ca-e6fc84cbce01 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:00.496656 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-40462d8d-e04b-4fd7-85ca-e6fc84cbce01 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.172254 Jul 11 14:14:00.507763 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 32/73] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:00 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:00.535871 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d92c5032-8a10-40cc-b8dc-7b629c4e5b96 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:00.536920 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d92c5032-8a10-40cc-b8dc-7b629c4e5b96 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:00.543862 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-89a8a49f-f815-49b1-9ac1-e5a25835eb13 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:00.544129 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d92c5032-8a10-40cc-b8dc-7b629c4e5b96 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:00.555701 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d92c5032-8a10-40cc-b8dc-7b629c4e5b96 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:00.556745 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d92c5032-8a10-40cc-b8dc-7b629c4e5b96 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:00.557639 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d92c5032-8a10-40cc-b8dc-7b629c4e5b96 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:00.559460 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-89a8a49f-f815-49b1-9ac1-e5a25835eb13 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.184351 Jul 11 14:14:00.560051 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 42/74] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:00 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:00.687812 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d92c5032-8a10-40cc-b8dc-7b629c4e5b96 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:00.695463 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d92c5032-8a10-40cc-b8dc-7b629c4e5b96 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.163692 Jul 11 14:14:00.696028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 33/75] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:00 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:01.513939 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0f76a440-822b-496e-8644-283d52b60a23 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:01.514619 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0f76a440-822b-496e-8644-283d52b60a23 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:01.520720 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f76a440-822b-496e-8644-283d52b60a23 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:01.521169 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f76a440-822b-496e-8644-283d52b60a23 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:01.521964 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f76a440-822b-496e-8644-283d52b60a23 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:01.522436 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f76a440-822b-496e-8644-283d52b60a23 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:01.578204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-989ec1b8-1ad3-410c-b857-577730599988 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:01.578843 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-989ec1b8-1ad3-410c-b857-577730599988 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:01.585087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-989ec1b8-1ad3-410c-b857-577730599988 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:01.585600 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-989ec1b8-1ad3-410c-b857-577730599988 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:01.587107 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-989ec1b8-1ad3-410c-b857-577730599988 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:01.587107 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-989ec1b8-1ad3-410c-b857-577730599988 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:01.660747 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0f76a440-822b-496e-8644-283d52b60a23 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:01.669095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0f76a440-822b-496e-8644-283d52b60a23 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.158848 Jul 11 14:14:01.669597 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 43/76] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:01 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:01.712796 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-82455505-745d-4cab-a411-ce8a4f19ed0a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:01.713510 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-82455505-745d-4cab-a411-ce8a4f19ed0a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:01.719598 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82455505-745d-4cab-a411-ce8a4f19ed0a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:01.720041 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82455505-745d-4cab-a411-ce8a4f19ed0a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:01.720812 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82455505-745d-4cab-a411-ce8a4f19ed0a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:01.721240 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82455505-745d-4cab-a411-ce8a4f19ed0a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:01.731116 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-989ec1b8-1ad3-410c-b857-577730599988 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:01.738617 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-989ec1b8-1ad3-410c-b857-577730599988 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.165996 Jul 11 14:14:01.739188 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 34/77] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:01 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:01.857139 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-82455505-745d-4cab-a411-ce8a4f19ed0a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:01.865028 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-82455505-745d-4cab-a411-ce8a4f19ed0a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.156196 Jul 11 14:14:01.865563 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 44/78] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:01 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:02.686387 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ef984c7a-2099-4b5c-b928-5b571ea4216a tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:02.687553 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ef984c7a-2099-4b5c-b928-5b571ea4216a tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:02.694716 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef984c7a-2099-4b5c-b928-5b571ea4216a tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:02.695161 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef984c7a-2099-4b5c-b928-5b571ea4216a tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:02.696102 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef984c7a-2099-4b5c-b928-5b571ea4216a tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:02.696691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef984c7a-2099-4b5c-b928-5b571ea4216a tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:02.758817 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-09725f37-42a1-4c35-899f-fa0a3fe9aef8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:02.759441 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-09725f37-42a1-4c35-899f-fa0a3fe9aef8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:02.765650 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09725f37-42a1-4c35-899f-fa0a3fe9aef8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:02.766132 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09725f37-42a1-4c35-899f-fa0a3fe9aef8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:02.766993 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09725f37-42a1-4c35-899f-fa0a3fe9aef8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:02.768414 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09725f37-42a1-4c35-899f-fa0a3fe9aef8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:02.854388 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ef984c7a-2099-4b5c-b928-5b571ea4216a tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:02.862015 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ef984c7a-2099-4b5c-b928-5b571ea4216a tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.179423 Jul 11 14:14:02.862643 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 35/79] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:02 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:02.886148 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-21d4a0a2-1f25-44aa-9296-6c7d1326ecf4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:02.887004 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-21d4a0a2-1f25-44aa-9296-6c7d1326ecf4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:02.893079 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-21d4a0a2-1f25-44aa-9296-6c7d1326ecf4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:02.893526 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-21d4a0a2-1f25-44aa-9296-6c7d1326ecf4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:02.894315 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-21d4a0a2-1f25-44aa-9296-6c7d1326ecf4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:02.894747 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-21d4a0a2-1f25-44aa-9296-6c7d1326ecf4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:02.912680 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-09725f37-42a1-4c35-899f-fa0a3fe9aef8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:02.920840 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-09725f37-42a1-4c35-899f-fa0a3fe9aef8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.168050 Jul 11 14:14:02.921417 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 45/80] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:02 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:03.033160 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-21d4a0a2-1f25-44aa-9296-6c7d1326ecf4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:03.041532 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-21d4a0a2-1f25-44aa-9296-6c7d1326ecf4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.160145 Jul 11 14:14:03.042104 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 36/81] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:02 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:03.882969 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-356c1041-e49a-4cf1-8112-953196f8f389 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:03.883882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-356c1041-e49a-4cf1-8112-953196f8f389 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:03.890178 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-356c1041-e49a-4cf1-8112-953196f8f389 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:03.890635 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-356c1041-e49a-4cf1-8112-953196f8f389 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:03.891394 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-356c1041-e49a-4cf1-8112-953196f8f389 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:03.891820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-356c1041-e49a-4cf1-8112-953196f8f389 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:03.938333 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-78acd464-6409-45f5-8caf-fa12cf91ad24 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:03.938976 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-78acd464-6409-45f5-8caf-fa12cf91ad24 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:03.945563 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78acd464-6409-45f5-8caf-fa12cf91ad24 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:03.946011 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78acd464-6409-45f5-8caf-fa12cf91ad24 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:03.946819 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78acd464-6409-45f5-8caf-fa12cf91ad24 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:03.947248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78acd464-6409-45f5-8caf-fa12cf91ad24 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:04.031145 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-356c1041-e49a-4cf1-8112-953196f8f389 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:04.039150 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-356c1041-e49a-4cf1-8112-953196f8f389 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.161285 Jul 11 14:14:04.039755 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 46/82] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:03 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:04.058900 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eb032602-8d04-4467-a62d-aa7c4d5eb576 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:04.059439 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eb032602-8d04-4467-a62d-aa7c4d5eb576 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:04.074387 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb032602-8d04-4467-a62d-aa7c4d5eb576 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:04.074843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb032602-8d04-4467-a62d-aa7c4d5eb576 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:04.075634 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb032602-8d04-4467-a62d-aa7c4d5eb576 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:04.076263 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb032602-8d04-4467-a62d-aa7c4d5eb576 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:04.087801 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-78acd464-6409-45f5-8caf-fa12cf91ad24 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:04.096783 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-78acd464-6409-45f5-8caf-fa12cf91ad24 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.162262 Jul 11 14:14:04.097361 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 37/83] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:03 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:04.218183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eb032602-8d04-4467-a62d-aa7c4d5eb576 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:04.225796 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eb032602-8d04-4467-a62d-aa7c4d5eb576 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.170838 Jul 11 14:14:04.226409 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 47/84] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:04 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:05.058305 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8da6a5ee-82a4-4ade-9281-5cea5b4542c0 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:05.059305 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8da6a5ee-82a4-4ade-9281-5cea5b4542c0 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:05.065755 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8da6a5ee-82a4-4ade-9281-5cea5b4542c0 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:05.066226 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8da6a5ee-82a4-4ade-9281-5cea5b4542c0 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:05.067005 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8da6a5ee-82a4-4ade-9281-5cea5b4542c0 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:05.067436 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8da6a5ee-82a4-4ade-9281-5cea5b4542c0 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:05.115973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4ff5f2a5-0912-4c46-b1aa-98cd78ed9ac5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:05.116996 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4ff5f2a5-0912-4c46-b1aa-98cd78ed9ac5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:05.125866 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ff5f2a5-0912-4c46-b1aa-98cd78ed9ac5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:05.126429 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ff5f2a5-0912-4c46-b1aa-98cd78ed9ac5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:05.127213 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ff5f2a5-0912-4c46-b1aa-98cd78ed9ac5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:05.127649 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ff5f2a5-0912-4c46-b1aa-98cd78ed9ac5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:05.220009 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8da6a5ee-82a4-4ade-9281-5cea5b4542c0 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:05.228472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8da6a5ee-82a4-4ade-9281-5cea5b4542c0 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.175808 Jul 11 14:14:05.229051 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 38/85] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:05 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:05.242453 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6c650793-8b9a-4cec-9348-96777969ab17 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:05.243066 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6c650793-8b9a-4cec-9348-96777969ab17 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:05.249210 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c650793-8b9a-4cec-9348-96777969ab17 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:05.249625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c650793-8b9a-4cec-9348-96777969ab17 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:05.250413 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c650793-8b9a-4cec-9348-96777969ab17 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:05.250844 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c650793-8b9a-4cec-9348-96777969ab17 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:05.265554 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4ff5f2a5-0912-4c46-b1aa-98cd78ed9ac5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:05.273737 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4ff5f2a5-0912-4c46-b1aa-98cd78ed9ac5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.162017 Jul 11 14:14:05.274357 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 48/86] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:05 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:05.384081 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6c650793-8b9a-4cec-9348-96777969ab17 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:05.391881 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6c650793-8b9a-4cec-9348-96777969ab17 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.153171 Jul 11 14:14:05.392541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 39/87] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:05 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:05.778953 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-fbead15d-eef3-4140-8e44-fbe5aaf146c4 req-fdbdb414-cdae-4a8a-a6d4-4c9ec4b1f6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b6aebc-3e65-4609-a344-61462c14e25d", "name": "network-vif-plugged", "status": "completed", "tag": "5f3f18ed-2057-426c-9899-844263690d4b"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:14:05.791911 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-fbead15d-eef3-4140-8e44-fbe5aaf146c4 req-fdbdb414-cdae-4a8a-a6d4-4c9ec4b1f6b0 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:05.792275 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-fbead15d-eef3-4140-8e44-fbe5aaf146c4 req-fdbdb414-cdae-4a8a-a6d4-4c9ec4b1f6b0 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:05.807679 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-fbead15d-eef3-4140-8e44-fbe5aaf146c4 req-fdbdb414-cdae-4a8a-a6d4-4c9ec4b1f6b0 service nova] Creating event network-vif-plugged:5f3f18ed-2057-426c-9899-844263690d4b for instance a7b6aebc-3e65-4609-a344-61462c14e25d on hv-cinder-81914 Jul 11 14:14:05.815777 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-fbead15d-eef3-4140-8e44-fbe5aaf146c4 req-fdbdb414-cdae-4a8a-a6d4-4c9ec4b1f6b0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041699 Jul 11 14:14:05.816707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 49/88] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:14:06.273158 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c8d0801c-c3e0-4776-b2d0-333b055b1d47 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:06.273158 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c8d0801c-c3e0-4776-b2d0-333b055b1d47 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:06.292816 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c8d0801c-c3e0-4776-b2d0-333b055b1d47 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:06.292816 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c8d0801c-c3e0-4776-b2d0-333b055b1d47 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:06.292816 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c8d0801c-c3e0-4776-b2d0-333b055b1d47 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:06.292816 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c8d0801c-c3e0-4776-b2d0-333b055b1d47 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:06.293187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8e30af88-7178-4eb0-8980-4c15d3b25d99 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:06.293187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8e30af88-7178-4eb0-8980-4c15d3b25d99 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:06.305410 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e30af88-7178-4eb0-8980-4c15d3b25d99 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:06.305862 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e30af88-7178-4eb0-8980-4c15d3b25d99 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:06.306664 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e30af88-7178-4eb0-8980-4c15d3b25d99 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:06.307113 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e30af88-7178-4eb0-8980-4c15d3b25d99 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:06.479994 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8e30af88-7178-4eb0-8980-4c15d3b25d99 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:06.483555 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c8d0801c-c3e0-4776-b2d0-333b055b1d47 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:06.489053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8e30af88-7178-4eb0-8980-4c15d3b25d99 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.202519 Jul 11 14:14:06.489731 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 50/89] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:06 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:06.493074 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c8d0801c-c3e0-4776-b2d0-333b055b1d47 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.245634 Jul 11 14:14:06.493671 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 40/90] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:06 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:06.508271 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a981afbf-bed2-48f5-a0cd-2ab9c989cfe2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:06.508920 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a981afbf-bed2-48f5-a0cd-2ab9c989cfe2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:06.515298 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a981afbf-bed2-48f5-a0cd-2ab9c989cfe2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:06.515748 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a981afbf-bed2-48f5-a0cd-2ab9c989cfe2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:06.516525 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a981afbf-bed2-48f5-a0cd-2ab9c989cfe2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:06.517135 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a981afbf-bed2-48f5-a0cd-2ab9c989cfe2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:06.664754 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a981afbf-bed2-48f5-a0cd-2ab9c989cfe2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:06.674011 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a981afbf-bed2-48f5-a0cd-2ab9c989cfe2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.182914 Jul 11 14:14:06.674644 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 51/91] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:06 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:07.505285 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1d1c7d69-349e-4592-ba8c-aaec9241ddb8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:07.507195 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1d1c7d69-349e-4592-ba8c-aaec9241ddb8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:07.510971 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2a9bfe4d-c85a-460d-a23b-abdcf7183ea7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:07.511674 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2a9bfe4d-c85a-460d-a23b-abdcf7183ea7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:07.513699 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1d1c7d69-349e-4592-ba8c-aaec9241ddb8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:07.514143 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1d1c7d69-349e-4592-ba8c-aaec9241ddb8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:07.515101 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1d1c7d69-349e-4592-ba8c-aaec9241ddb8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:07.515677 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1d1c7d69-349e-4592-ba8c-aaec9241ddb8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:07.518010 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a9bfe4d-c85a-460d-a23b-abdcf7183ea7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:07.518475 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a9bfe4d-c85a-460d-a23b-abdcf7183ea7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:07.519249 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a9bfe4d-c85a-460d-a23b-abdcf7183ea7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:07.519686 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a9bfe4d-c85a-460d-a23b-abdcf7183ea7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:07.656592 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1d1c7d69-349e-4592-ba8c-aaec9241ddb8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:07.664861 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1d1c7d69-349e-4592-ba8c-aaec9241ddb8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.163327 Jul 11 14:14:07.665448 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 41/92] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:07 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:07.692613 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7ecb3ba6-7e71-437c-8cc6-79c1458c0976 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:07.693483 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7ecb3ba6-7e71-437c-8cc6-79c1458c0976 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:07.694824 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2a9bfe4d-c85a-460d-a23b-abdcf7183ea7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:07.701657 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ecb3ba6-7e71-437c-8cc6-79c1458c0976 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:07.702402 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ecb3ba6-7e71-437c-8cc6-79c1458c0976 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:07.703149 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2a9bfe4d-c85a-460d-a23b-abdcf7183ea7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.196476 Jul 11 14:14:07.703353 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ecb3ba6-7e71-437c-8cc6-79c1458c0976 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:07.703793 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ecb3ba6-7e71-437c-8cc6-79c1458c0976 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:07.713729 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 52/93] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:07 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:07.720548 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:07.840706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-7a871763-91c8-4cc3-8590-6f107f1ef719 req-a231b691-5d81-4721-8a7d-7c4453cfcc58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da6649c5-69b0-4e1f-992c-62f13a87ea6d", "name": "network-vif-plugged", "status": "completed", "tag": "4fdd29a5-a920-4c2e-933f-1853719c86d8"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:14:07.849505 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7a871763-91c8-4cc3-8590-6f107f1ef719 req-a231b691-5d81-4721-8a7d-7c4453cfcc58 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:07.850085 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7a871763-91c8-4cc3-8590-6f107f1ef719 req-a231b691-5d81-4721-8a7d-7c4453cfcc58 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:07.854417 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:07.863982 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-7a871763-91c8-4cc3-8590-6f107f1ef719 req-a231b691-5d81-4721-8a7d-7c4453cfcc58 service nova] Creating event network-vif-plugged:4fdd29a5-a920-4c2e-933f-1853719c86d8 for instance da6649c5-69b0-4e1f-992c-62f13a87ea6d on hv-cinder-81914 Jul 11 14:14:07.869571 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-7a871763-91c8-4cc3-8590-6f107f1ef719 req-a231b691-5d81-4721-8a7d-7c4453cfcc58 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034998 Jul 11 14:14:07.870695 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 53/94] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:14:07.891489 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7ecb3ba6-7e71-437c-8cc6-79c1458c0976 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:07.901925 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7ecb3ba6-7e71-437c-8cc6-79c1458c0976 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.213380 Jul 11 14:14:07.902755 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 42/95] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:07 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:08.682613 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-72d8f1f5-d7fb-464c-8c6a-ab1f4d898718 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:08.683309 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-72d8f1f5-d7fb-464c-8c6a-ab1f4d898718 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:08.689518 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-72d8f1f5-d7fb-464c-8c6a-ab1f4d898718 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:08.689964 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-72d8f1f5-d7fb-464c-8c6a-ab1f4d898718 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:08.690749 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-72d8f1f5-d7fb-464c-8c6a-ab1f4d898718 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:08.691175 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-72d8f1f5-d7fb-464c-8c6a-ab1f4d898718 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:08.721208 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8b91cdd1-1dd3-4644-a02f-c570a89cf37c tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:08.721753 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8b91cdd1-1dd3-4644-a02f-c570a89cf37c tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:08.727709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=4 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:08.730056 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b91cdd1-1dd3-4644-a02f-c570a89cf37c tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:08.730227 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b91cdd1-1dd3-4644-a02f-c570a89cf37c tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:08.731174 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b91cdd1-1dd3-4644-a02f-c570a89cf37c tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:08.731780 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b91cdd1-1dd3-4644-a02f-c570a89cf37c tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:08.837352 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-72d8f1f5-d7fb-464c-8c6a-ab1f4d898718 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:08.847005 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-72d8f1f5-d7fb-464c-8c6a-ab1f4d898718 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.169220 Jul 11 14:14:08.854749 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 54/96] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:08 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:08.876018 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8b91cdd1-1dd3-4644-a02f-c570a89cf37c tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:08.885982 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8b91cdd1-1dd3-4644-a02f-c570a89cf37c tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.168866 Jul 11 14:14:08.886616 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 43/97] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:08 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:08.918834 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b4830a7a-9142-4b2d-a80c-f8fe52148843 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:08.919450 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b4830a7a-9142-4b2d-a80c-f8fe52148843 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:08.927394 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4830a7a-9142-4b2d-a80c-f8fe52148843 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:08.928211 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4830a7a-9142-4b2d-a80c-f8fe52148843 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:08.929547 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4830a7a-9142-4b2d-a80c-f8fe52148843 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:08.930348 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4830a7a-9142-4b2d-a80c-f8fe52148843 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:09.078855 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b4830a7a-9142-4b2d-a80c-f8fe52148843 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:09.087064 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b4830a7a-9142-4b2d-a80c-f8fe52148843 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.172059 Jul 11 14:14:09.087644 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 55/98] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:08 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:09.864449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f7a194d2-3540-41f6-a3e7-2a2f853eec50 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:09.865091 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f7a194d2-3540-41f6-a3e7-2a2f853eec50 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:09.871948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7a194d2-3540-41f6-a3e7-2a2f853eec50 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:09.872392 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7a194d2-3540-41f6-a3e7-2a2f853eec50 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:09.873164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7a194d2-3540-41f6-a3e7-2a2f853eec50 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:09.873595 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7a194d2-3540-41f6-a3e7-2a2f853eec50 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:09.904199 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e9ef71cb-3c18-41bc-b21a-a8254c7633e2 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:09.905425 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e9ef71cb-3c18-41bc-b21a-a8254c7633e2 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:09.911904 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9ef71cb-3c18-41bc-b21a-a8254c7633e2 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:09.912882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9ef71cb-3c18-41bc-b21a-a8254c7633e2 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:09.913921 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9ef71cb-3c18-41bc-b21a-a8254c7633e2 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:09.914411 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9ef71cb-3c18-41bc-b21a-a8254c7633e2 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:10.030797 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f7a194d2-3540-41f6-a3e7-2a2f853eec50 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:10.038834 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f7a194d2-3540-41f6-a3e7-2a2f853eec50 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.178230 Jul 11 14:14:10.039413 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 44/99] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:09 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:10.064593 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e9ef71cb-3c18-41bc-b21a-a8254c7633e2 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:10.072211 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e9ef71cb-3c18-41bc-b21a-a8254c7633e2 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.172567 Jul 11 14:14:10.072779 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 56/100] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:09 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:10.104220 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a632e346-b963-410f-b348-91d749f7a067 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:10.104984 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a632e346-b963-410f-b348-91d749f7a067 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:10.111294 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a632e346-b963-410f-b348-91d749f7a067 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:10.111938 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a632e346-b963-410f-b348-91d749f7a067 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:10.112714 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a632e346-b963-410f-b348-91d749f7a067 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:10.113153 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a632e346-b963-410f-b348-91d749f7a067 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:10.280085 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a632e346-b963-410f-b348-91d749f7a067 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:10.288894 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a632e346-b963-410f-b348-91d749f7a067 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.189317 Jul 11 14:14:10.289486 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 45/101] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:10 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:11.055714 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-38d11367-0a30-4acd-aa87-1c55b2069ad1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:11.056411 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-38d11367-0a30-4acd-aa87-1c55b2069ad1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:11.063436 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38d11367-0a30-4acd-aa87-1c55b2069ad1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:11.064211 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38d11367-0a30-4acd-aa87-1c55b2069ad1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:11.065046 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38d11367-0a30-4acd-aa87-1c55b2069ad1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:11.065481 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38d11367-0a30-4acd-aa87-1c55b2069ad1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:11.088825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-287cb99e-4b79-4dc4-8cb6-eb43b7fa5cdb tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:11.089419 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-287cb99e-4b79-4dc4-8cb6-eb43b7fa5cdb tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:11.095571 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-287cb99e-4b79-4dc4-8cb6-eb43b7fa5cdb tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:11.096012 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-287cb99e-4b79-4dc4-8cb6-eb43b7fa5cdb tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:11.096803 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-287cb99e-4b79-4dc4-8cb6-eb43b7fa5cdb tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:11.097245 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-287cb99e-4b79-4dc4-8cb6-eb43b7fa5cdb tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:11.211318 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-38d11367-0a30-4acd-aa87-1c55b2069ad1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:11.221386 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-38d11367-0a30-4acd-aa87-1c55b2069ad1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.169941 Jul 11 14:14:11.222014 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 57/102] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:11 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:11.234409 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-287cb99e-4b79-4dc4-8cb6-eb43b7fa5cdb tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:11.242881 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-287cb99e-4b79-4dc4-8cb6-eb43b7fa5cdb tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.157825 Jul 11 14:14:11.243560 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 46/103] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:11 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:11.306946 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-89378530-0441-4e29-99d3-33bd736eca22 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:11.307491 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-89378530-0441-4e29-99d3-33bd736eca22 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:11.314685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89378530-0441-4e29-99d3-33bd736eca22 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:11.315224 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89378530-0441-4e29-99d3-33bd736eca22 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:11.316016 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89378530-0441-4e29-99d3-33bd736eca22 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:11.316483 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89378530-0441-4e29-99d3-33bd736eca22 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:11.509770 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-89378530-0441-4e29-99d3-33bd736eca22 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:11.524019 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-89378530-0441-4e29-99d3-33bd736eca22 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.219604 Jul 11 14:14:11.534981 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 58/104] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:11 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:12.239412 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-62052cdd-d3c7-4d2e-82bd-ac8c2a701385 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:12.241487 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-62052cdd-d3c7-4d2e-82bd-ac8c2a701385 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:12.247787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-62052cdd-d3c7-4d2e-82bd-ac8c2a701385 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:12.248444 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-62052cdd-d3c7-4d2e-82bd-ac8c2a701385 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:12.249359 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-62052cdd-d3c7-4d2e-82bd-ac8c2a701385 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:12.249934 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-62052cdd-d3c7-4d2e-82bd-ac8c2a701385 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:12.261717 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-acc64545-53e3-450a-90c7-9e234c183bb8 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:12.262393 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-acc64545-53e3-450a-90c7-9e234c183bb8 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:12.270078 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-acc64545-53e3-450a-90c7-9e234c183bb8 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:12.270626 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-acc64545-53e3-450a-90c7-9e234c183bb8 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:12.271490 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-acc64545-53e3-450a-90c7-9e234c183bb8 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:12.272130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-acc64545-53e3-450a-90c7-9e234c183bb8 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:12.472622 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-acc64545-53e3-450a-90c7-9e234c183bb8 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:12.482708 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-acc64545-53e3-450a-90c7-9e234c183bb8 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1314 microversion: 2.1 time: 0.226032 Jul 11 14:14:12.483701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 59/105] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:12 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:12.488384 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-62052cdd-d3c7-4d2e-82bd-ac8c2a701385 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:12.505172 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-62052cdd-d3c7-4d2e-82bd-ac8c2a701385 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.269299 Jul 11 14:14:12.505947 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 47/106] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:12 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:12.541532 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-352eb95b-8cea-4364-8f10-b3f2323aae33 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:12.542176 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-352eb95b-8cea-4364-8f10-b3f2323aae33 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:12.548253 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-352eb95b-8cea-4364-8f10-b3f2323aae33 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:12.548698 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-352eb95b-8cea-4364-8f10-b3f2323aae33 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:12.549464 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-352eb95b-8cea-4364-8f10-b3f2323aae33 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:12.549900 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-352eb95b-8cea-4364-8f10-b3f2323aae33 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:12.690777 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-352eb95b-8cea-4364-8f10-b3f2323aae33 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:12.698667 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-352eb95b-8cea-4364-8f10-b3f2323aae33 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.161386 Jul 11 14:14:12.699253 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 60/107] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:12 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:13.517136 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b9b1973e-d946-463c-a675-d9c16fa2d114 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:13.518981 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b9b1973e-d946-463c-a675-d9c16fa2d114 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:13.532001 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b9b1973e-d946-463c-a675-d9c16fa2d114 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:13.533008 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b9b1973e-d946-463c-a675-d9c16fa2d114 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:13.534312 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b9b1973e-d946-463c-a675-d9c16fa2d114 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:13.534937 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b9b1973e-d946-463c-a675-d9c16fa2d114 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:13.538721 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-56bf4571-f8c0-4519-8dff-0d7ba3bf1c82 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:13.544955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-56bf4571-f8c0-4519-8dff-0d7ba3bf1c82 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:13.569344 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-56bf4571-f8c0-4519-8dff-0d7ba3bf1c82 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:13.570100 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-56bf4571-f8c0-4519-8dff-0d7ba3bf1c82 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:13.571441 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-56bf4571-f8c0-4519-8dff-0d7ba3bf1c82 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:13.572183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-56bf4571-f8c0-4519-8dff-0d7ba3bf1c82 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:13.803572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b9b1973e-d946-463c-a675-d9c16fa2d114 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:13.813611 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b9b1973e-d946-463c-a675-d9c16fa2d114 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1500 microversion: 2.1 time: 0.304485 Jul 11 14:14:13.821794 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 48/108] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:13 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1500 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:13.830665 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1a1aac56-d2ac-48b1-9ca9-4d964aab65f0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:13.831561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1a1aac56-d2ac-48b1-9ca9-4d964aab65f0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:13.841437 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1a1aac56-d2ac-48b1-9ca9-4d964aab65f0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:13.850842 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1a1aac56-d2ac-48b1-9ca9-4d964aab65f0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:13.852751 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1a1aac56-d2ac-48b1-9ca9-4d964aab65f0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:13.853561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1a1aac56-d2ac-48b1-9ca9-4d964aab65f0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:13.887225 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-56bf4571-f8c0-4519-8dff-0d7ba3bf1c82 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:13.900854 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-56bf4571-f8c0-4519-8dff-0d7ba3bf1c82 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.371456 Jul 11 14:14:13.910933 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 61/109] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:13 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:14.008277 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1a1aac56-d2ac-48b1-9ca9-4d964aab65f0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:14.017524 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1a1aac56-d2ac-48b1-9ca9-4d964aab65f0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.194600 Jul 11 14:14:14.018401 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 49/110] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:13 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:14.917579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e0e7ba55-4c12-4210-b797-4b3fd0c70976 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:14.918234 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e0e7ba55-4c12-4210-b797-4b3fd0c70976 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:14.924809 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0e7ba55-4c12-4210-b797-4b3fd0c70976 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:14.925256 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0e7ba55-4c12-4210-b797-4b3fd0c70976 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:14.926026 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0e7ba55-4c12-4210-b797-4b3fd0c70976 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:14.926504 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0e7ba55-4c12-4210-b797-4b3fd0c70976 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:15.036948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-50e7ff84-ef76-4fbb-9fa2-69255eefe547 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:15.039202 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-50e7ff84-ef76-4fbb-9fa2-69255eefe547 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:15.041604 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:15.049058 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50e7ff84-ef76-4fbb-9fa2-69255eefe547 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:15.049664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50e7ff84-ef76-4fbb-9fa2-69255eefe547 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:15.050794 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50e7ff84-ef76-4fbb-9fa2-69255eefe547 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:15.051265 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50e7ff84-ef76-4fbb-9fa2-69255eefe547 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:15.143343 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e0e7ba55-4c12-4210-b797-4b3fd0c70976 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:15.152659 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e0e7ba55-4c12-4210-b797-4b3fd0c70976 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.238800 Jul 11 14:14:15.153776 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 62/111] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:14 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:15.250711 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-50e7ff84-ef76-4fbb-9fa2-69255eefe547 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:15.269702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-50e7ff84-ef76-4fbb-9fa2-69255eefe547 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.236729 Jul 11 14:14:15.270500 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 50/112] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:15 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:16.168886 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-680fafd0-c4a3-4526-a2c8-b3e839f55880 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:16.169505 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-680fafd0-c4a3-4526-a2c8-b3e839f55880 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:16.177305 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-680fafd0-c4a3-4526-a2c8-b3e839f55880 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:16.178432 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-680fafd0-c4a3-4526-a2c8-b3e839f55880 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:16.179385 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-680fafd0-c4a3-4526-a2c8-b3e839f55880 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:16.179816 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-680fafd0-c4a3-4526-a2c8-b3e839f55880 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:16.288281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e520e055-aa6e-47f6-8722-039067002731 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:16.289484 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e520e055-aa6e-47f6-8722-039067002731 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:16.296629 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e520e055-aa6e-47f6-8722-039067002731 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:16.297352 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e520e055-aa6e-47f6-8722-039067002731 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:16.298204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e520e055-aa6e-47f6-8722-039067002731 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:16.298654 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e520e055-aa6e-47f6-8722-039067002731 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:16.347217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-680fafd0-c4a3-4526-a2c8-b3e839f55880 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:16.359961 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-680fafd0-c4a3-4526-a2c8-b3e839f55880 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.194256 Jul 11 14:14:16.361608 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 63/113] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:16 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:16.453696 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e520e055-aa6e-47f6-8722-039067002731 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:16.461711 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e520e055-aa6e-47f6-8722-039067002731 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.177984 Jul 11 14:14:16.462355 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 51/114] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:16 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:17.377806 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d11d5b96-8b11-4f15-903d-b40117c43b51 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:17.378557 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d11d5b96-8b11-4f15-903d-b40117c43b51 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:17.385995 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d11d5b96-8b11-4f15-903d-b40117c43b51 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:17.386429 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d11d5b96-8b11-4f15-903d-b40117c43b51 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:17.387285 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d11d5b96-8b11-4f15-903d-b40117c43b51 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:17.387837 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d11d5b96-8b11-4f15-903d-b40117c43b51 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:17.479598 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-38296f6c-8fdb-42a8-9154-c46d21820896 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:17.480216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-38296f6c-8fdb-42a8-9154-c46d21820896 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:17.486489 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38296f6c-8fdb-42a8-9154-c46d21820896 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:17.487191 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38296f6c-8fdb-42a8-9154-c46d21820896 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:17.487964 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38296f6c-8fdb-42a8-9154-c46d21820896 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:17.488404 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38296f6c-8fdb-42a8-9154-c46d21820896 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:17.536082 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d11d5b96-8b11-4f15-903d-b40117c43b51 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:17.544324 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d11d5b96-8b11-4f15-903d-b40117c43b51 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.170321 Jul 11 14:14:17.545154 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 64/115] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:17 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:17.636999 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-38296f6c-8fdb-42a8-9154-c46d21820896 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:17.649902 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-38296f6c-8fdb-42a8-9154-c46d21820896 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.174138 Jul 11 14:14:17.650520 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 52/116] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:17 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:18.562126 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6e2b4dfc-5516-47c2-ae5d-b97c53dd63be tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:18.562841 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6e2b4dfc-5516-47c2-ae5d-b97c53dd63be tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:18.569828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e2b4dfc-5516-47c2-ae5d-b97c53dd63be tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:18.570314 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e2b4dfc-5516-47c2-ae5d-b97c53dd63be tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:18.571088 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e2b4dfc-5516-47c2-ae5d-b97c53dd63be tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:18.571529 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e2b4dfc-5516-47c2-ae5d-b97c53dd63be tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:18.667154 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6d3efd4d-8f4a-4b9e-9e2e-e76f2f77faac tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:18.668461 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6d3efd4d-8f4a-4b9e-9e2e-e76f2f77faac tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:18.675063 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6d3efd4d-8f4a-4b9e-9e2e-e76f2f77faac tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:18.675827 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6d3efd4d-8f4a-4b9e-9e2e-e76f2f77faac tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:18.676906 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6d3efd4d-8f4a-4b9e-9e2e-e76f2f77faac tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:18.677943 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6d3efd4d-8f4a-4b9e-9e2e-e76f2f77faac tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:18.714568 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6e2b4dfc-5516-47c2-ae5d-b97c53dd63be tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:18.722499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6e2b4dfc-5516-47c2-ae5d-b97c53dd63be tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.164400 Jul 11 14:14:18.723242 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 65/117] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:18 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:18.813388 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6d3efd4d-8f4a-4b9e-9e2e-e76f2f77faac tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:18.821434 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6d3efd4d-8f4a-4b9e-9e2e-e76f2f77faac tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.158645 Jul 11 14:14:18.822019 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 53/118] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:18 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:19.739572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d34c6d3c-04ab-4d20-a6ab-a796cd23d741 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:19.740835 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d34c6d3c-04ab-4d20-a6ab-a796cd23d741 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:19.744985 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-102d308a-abf1-416f-857a-a14968d2a917 req-346cf262-5566-4000-8a7a-6b45439fa334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f5f00b-3f48-4d27-9330-2b61cfa19d27", "name": "network-vif-plugged", "status": "completed", "tag": "0b6e7c6b-601e-412f-b987-a5b8f2bb58b7"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:14:19.749761 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d34c6d3c-04ab-4d20-a6ab-a796cd23d741 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:19.750220 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d34c6d3c-04ab-4d20-a6ab-a796cd23d741 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:19.751020 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d34c6d3c-04ab-4d20-a6ab-a796cd23d741 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:19.751454 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d34c6d3c-04ab-4d20-a6ab-a796cd23d741 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:19.778031 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-102d308a-abf1-416f-857a-a14968d2a917 req-346cf262-5566-4000-8a7a-6b45439fa334 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:19.779496 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-102d308a-abf1-416f-857a-a14968d2a917 req-346cf262-5566-4000-8a7a-6b45439fa334 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:19.830131 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-102d308a-abf1-416f-857a-a14968d2a917 req-346cf262-5566-4000-8a7a-6b45439fa334 service nova] Creating event network-vif-plugged:0b6e7c6b-601e-412f-b987-a5b8f2bb58b7 for instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 on hv-cinder-81914 Jul 11 14:14:19.847684 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-102d308a-abf1-416f-857a-a14968d2a917 req-346cf262-5566-4000-8a7a-6b45439fa334 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117293 Jul 11 14:14:19.849805 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 66/119] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:14:19.856108 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-997a52bf-6c09-4097-b5f3-8a2ee0660d48 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:19.856858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-997a52bf-6c09-4097-b5f3-8a2ee0660d48 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:19.863802 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-997a52bf-6c09-4097-b5f3-8a2ee0660d48 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:19.864257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-997a52bf-6c09-4097-b5f3-8a2ee0660d48 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:19.866114 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-997a52bf-6c09-4097-b5f3-8a2ee0660d48 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:19.866792 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-997a52bf-6c09-4097-b5f3-8a2ee0660d48 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:20.062939 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-997a52bf-6c09-4097-b5f3-8a2ee0660d48 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:20.073972 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-997a52bf-6c09-4097-b5f3-8a2ee0660d48 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.222562 Jul 11 14:14:20.075154 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 67/120] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:19 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:20.184208 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d34c6d3c-04ab-4d20-a6ab-a796cd23d741 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:20.201549 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d34c6d3c-04ab-4d20-a6ab-a796cd23d741 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1321 microversion: 2.1 time: 0.464541 Jul 11 14:14:20.203143 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 54/121] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:19 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1321 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:20.616414 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-795d4aff-11be-4b52-ae78-ec504cab36e1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0710a086-07d9-4411-8424-ff08d14cd52a"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:14:20.617547 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-795d4aff-11be-4b52-ae78-ec504cab36e1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:20.624860 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-795d4aff-11be-4b52-ae78-ec504cab36e1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:20.625310 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-795d4aff-11be-4b52-ae78-ec504cab36e1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:20.626084 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-795d4aff-11be-4b52-ae78-ec504cab36e1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:20.626567 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-795d4aff-11be-4b52-ae78-ec504cab36e1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:21.092421 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-aa40a5e7-5967-428e-ae19-ea10356bc4e9 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:21.093166 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-aa40a5e7-5967-428e-ae19-ea10356bc4e9 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:21.099871 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aa40a5e7-5967-428e-ae19-ea10356bc4e9 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:21.100381 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aa40a5e7-5967-428e-ae19-ea10356bc4e9 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:21.101163 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aa40a5e7-5967-428e-ae19-ea10356bc4e9 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:21.101597 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aa40a5e7-5967-428e-ae19-ea10356bc4e9 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:21.256585 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-aa40a5e7-5967-428e-ae19-ea10356bc4e9 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:21.264968 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-aa40a5e7-5967-428e-ae19-ea10356bc4e9 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1361 microversion: 2.1 time: 0.176366 Jul 11 14:14:21.265639 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 55/122] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:21 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:21.278325 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-838f19dc-8830-4b3a-8b5d-f96f44a8c664 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:21.279489 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-838f19dc-8830-4b3a-8b5d-f96f44a8c664 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:21.287947 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-838f19dc-8830-4b3a-8b5d-f96f44a8c664 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:21.288492 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-838f19dc-8830-4b3a-8b5d-f96f44a8c664 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:21.289259 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-838f19dc-8830-4b3a-8b5d-f96f44a8c664 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:21.289687 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-838f19dc-8830-4b3a-8b5d-f96f44a8c664 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:21.454713 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-838f19dc-8830-4b3a-8b5d-f96f44a8c664 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:21.472218 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-838f19dc-8830-4b3a-8b5d-f96f44a8c664 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1515 microversion: 2.1 time: 0.205391 Jul 11 14:14:21.472757 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 56/123] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:21 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:21.496980 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-079a59c0-3eb5-4d83-9791-5544dbc105a2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:14:21.498705 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-079a59c0-3eb5-4d83-9791-5544dbc105a2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:21.505261 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-079a59c0-3eb5-4d83-9791-5544dbc105a2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:21.506004 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-079a59c0-3eb5-4d83-9791-5544dbc105a2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:21.507481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-079a59c0-3eb5-4d83-9791-5544dbc105a2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:21.507976 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-079a59c0-3eb5-4d83-9791-5544dbc105a2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:21.591138 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-079a59c0-3eb5-4d83-9791-5544dbc105a2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lazy-loading 'flavor' on Instance uuid da6649c5-69b0-4e1f-992c-62f13a87ea6d {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:14:21.727857 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:21.787385 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-079a59c0-3eb5-4d83-9791-5544dbc105a2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "POST /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d/action" status: 200 len: 32 microversion: 2.1 time: 0.300924 Jul 11 14:14:21.788297 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 57/124] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 11 14:14:21 2022] POST /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d/action => generated 32 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 11 14:14:21.804951 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-78ee5be8-fe63-4776-9e0e-f4947fbeb7b6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:21.805856 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-78ee5be8-fe63-4776-9e0e-f4947fbeb7b6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:21.813050 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78ee5be8-fe63-4776-9e0e-f4947fbeb7b6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:21.813685 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78ee5be8-fe63-4776-9e0e-f4947fbeb7b6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:21.814483 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78ee5be8-fe63-4776-9e0e-f4947fbeb7b6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:21.815530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78ee5be8-fe63-4776-9e0e-f4947fbeb7b6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:21.980247 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-78ee5be8-fe63-4776-9e0e-f4947fbeb7b6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:21.990586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-78ee5be8-fe63-4776-9e0e-f4947fbeb7b6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.195624 Jul 11 14:14:21.992570 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 58/125] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:21 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:22.282097 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a99105b8-6fb4-4061-a279-d1739239c4c9 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:22.284310 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a99105b8-6fb4-4061-a279-d1739239c4c9 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:22.292879 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a99105b8-6fb4-4061-a279-d1739239c4c9 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:22.293833 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a99105b8-6fb4-4061-a279-d1739239c4c9 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:22.294619 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a99105b8-6fb4-4061-a279-d1739239c4c9 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:22.295485 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a99105b8-6fb4-4061-a279-d1739239c4c9 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:22.707529 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a99105b8-6fb4-4061-a279-d1739239c4c9 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:22.716768 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a99105b8-6fb4-4061-a279-d1739239c4c9 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1548 microversion: 2.1 time: 0.438582 Jul 11 14:14:22.717508 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 59/126] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:22 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1548 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:22.738904 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-19ddcaca-77f8-4482-9c70-95c837acb57f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:22.739485 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-19ddcaca-77f8-4482-9c70-95c837acb57f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:22.746663 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19ddcaca-77f8-4482-9c70-95c837acb57f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:22.747332 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19ddcaca-77f8-4482-9c70-95c837acb57f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:22.748144 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19ddcaca-77f8-4482-9c70-95c837acb57f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:22.748589 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19ddcaca-77f8-4482-9c70-95c837acb57f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:22.838346 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-19ddcaca-77f8-4482-9c70-95c837acb57f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105265 Jul 11 14:14:22.838613 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 60/127] 10.222.0.66 () {58 vars in 1274 bytes} [Mon Jul 11 14:14:22 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:14:23.026387 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2c7bb461-ab68-4ffb-b82a-6562eaf71df0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:23.027728 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2c7bb461-ab68-4ffb-b82a-6562eaf71df0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:23.072917 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2c7bb461-ab68-4ffb-b82a-6562eaf71df0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:23.077012 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2c7bb461-ab68-4ffb-b82a-6562eaf71df0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:23.080046 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2c7bb461-ab68-4ffb-b82a-6562eaf71df0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:23.080652 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2c7bb461-ab68-4ffb-b82a-6562eaf71df0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:23.423525 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2c7bb461-ab68-4ffb-b82a-6562eaf71df0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:23.434351 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2c7bb461-ab68-4ffb-b82a-6562eaf71df0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.429638 Jul 11 14:14:23.434966 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 61/128] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:23 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:24.366975 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-4865c13c-e95f-4127-9de2-4a32ad3641c2 req-811bd8bd-8a0f-4a07-9fee-1344fd543040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f5f00b-3f48-4d27-9330-2b61cfa19d27", "tag": "0b6e7c6b-601e-412f-b987-a5b8f2bb58b7"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:14:24.375159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4865c13c-e95f-4127-9de2-4a32ad3641c2 req-811bd8bd-8a0f-4a07-9fee-1344fd543040 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:24.375593 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4865c13c-e95f-4127-9de2-4a32ad3641c2 req-811bd8bd-8a0f-4a07-9fee-1344fd543040 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:24.388097 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-4865c13c-e95f-4127-9de2-4a32ad3641c2 req-811bd8bd-8a0f-4a07-9fee-1344fd543040 service nova] Creating event network-changed:0b6e7c6b-601e-412f-b987-a5b8f2bb58b7 for instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 on hv-cinder-81914 Jul 11 14:14:24.394805 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-4865c13c-e95f-4127-9de2-4a32ad3641c2 req-811bd8bd-8a0f-4a07-9fee-1344fd543040 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032332 Jul 11 14:14:24.395405 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 62/129] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:14:24.452704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c18d1b3a-1986-42f8-90e4-5551d040e524 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:24.453417 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c18d1b3a-1986-42f8-90e4-5551d040e524 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:24.459885 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c18d1b3a-1986-42f8-90e4-5551d040e524 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:24.460338 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c18d1b3a-1986-42f8-90e4-5551d040e524 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:24.461315 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c18d1b3a-1986-42f8-90e4-5551d040e524 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:24.461754 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c18d1b3a-1986-42f8-90e4-5551d040e524 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:24.624627 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c18d1b3a-1986-42f8-90e4-5551d040e524 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:24.633466 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c18d1b3a-1986-42f8-90e4-5551d040e524 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.184899 Jul 11 14:14:24.634058 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 63/130] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:24 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:25.449174 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-795d4aff-11be-4b52-ae78-ec504cab36e1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "POST /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.837513 Jul 11 14:14:25.454392 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 68/131] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 11 14:14:20 2022] POST /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d/os-volume_attachments => generated 194 bytes in 4839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:14:25.653882 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ab6b8833-c510-4d76-a567-c119073a0e92 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:25.655566 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ab6b8833-c510-4d76-a567-c119073a0e92 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:25.670717 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ab6b8833-c510-4d76-a567-c119073a0e92 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:25.671411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ab6b8833-c510-4d76-a567-c119073a0e92 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:25.672392 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ab6b8833-c510-4d76-a567-c119073a0e92 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:25.672984 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ab6b8833-c510-4d76-a567-c119073a0e92 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:25.991905 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ab6b8833-c510-4d76-a567-c119073a0e92 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:26.000695 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ab6b8833-c510-4d76-a567-c119073a0e92 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.352724 Jul 11 14:14:26.001295 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 64/132] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:25 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:27.021021 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e43bda29-9af1-438a-868e-f3fc687ffafc tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:27.021781 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e43bda29-9af1-438a-868e-f3fc687ffafc tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:27.030064 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e43bda29-9af1-438a-868e-f3fc687ffafc tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:27.030597 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e43bda29-9af1-438a-868e-f3fc687ffafc tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:27.031415 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e43bda29-9af1-438a-868e-f3fc687ffafc tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:27.031854 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e43bda29-9af1-438a-868e-f3fc687ffafc tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:27.176310 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e43bda29-9af1-438a-868e-f3fc687ffafc tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:27.184489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:27.187111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e43bda29-9af1-438a-868e-f3fc687ffafc tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.172091 Jul 11 14:14:27.187866 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 69/133] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:27 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:28.207604 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c0a80946-5be8-43c2-956f-dadcd00da4fd tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:28.208499 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c0a80946-5be8-43c2-956f-dadcd00da4fd tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:28.218806 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c0a80946-5be8-43c2-956f-dadcd00da4fd tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:28.219844 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c0a80946-5be8-43c2-956f-dadcd00da4fd tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:28.220834 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c0a80946-5be8-43c2-956f-dadcd00da4fd tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:28.221300 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c0a80946-5be8-43c2-956f-dadcd00da4fd tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:28.400522 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c0a80946-5be8-43c2-956f-dadcd00da4fd tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:28.410817 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c0a80946-5be8-43c2-956f-dadcd00da4fd tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.209393 Jul 11 14:14:28.413394 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 65/134] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:28 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:29.430260 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6ec86027-07f2-45bb-bc80-66bbb990e028 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:29.430876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6ec86027-07f2-45bb-bc80-66bbb990e028 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:29.433220 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=64 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:29.439440 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ec86027-07f2-45bb-bc80-66bbb990e028 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:29.439886 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ec86027-07f2-45bb-bc80-66bbb990e028 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:29.440844 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ec86027-07f2-45bb-bc80-66bbb990e028 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:29.441477 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ec86027-07f2-45bb-bc80-66bbb990e028 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:29.641918 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6ec86027-07f2-45bb-bc80-66bbb990e028 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:29.652135 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6ec86027-07f2-45bb-bc80-66bbb990e028 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.225823 Jul 11 14:14:29.661414 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 70/135] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:29 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:30.669012 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-69c255f5-8a8c-4743-8c5f-4d0e24a0d279 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:30.671144 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-69c255f5-8a8c-4743-8c5f-4d0e24a0d279 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:30.683119 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-69c255f5-8a8c-4743-8c5f-4d0e24a0d279 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:30.683660 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-69c255f5-8a8c-4743-8c5f-4d0e24a0d279 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:30.689587 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-69c255f5-8a8c-4743-8c5f-4d0e24a0d279 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:30.690189 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-69c255f5-8a8c-4743-8c5f-4d0e24a0d279 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:30.877093 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-69c255f5-8a8c-4743-8c5f-4d0e24a0d279 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:30.886048 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-69c255f5-8a8c-4743-8c5f-4d0e24a0d279 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.220860 Jul 11 14:14:30.887232 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 66/136] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:30 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:31.909064 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-17c0f727-876a-4a77-a8e6-06d5ed36138b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:31.910392 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-17c0f727-876a-4a77-a8e6-06d5ed36138b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:31.920404 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17c0f727-876a-4a77-a8e6-06d5ed36138b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:31.923174 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17c0f727-876a-4a77-a8e6-06d5ed36138b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:31.925473 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17c0f727-876a-4a77-a8e6-06d5ed36138b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:31.926251 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17c0f727-876a-4a77-a8e6-06d5ed36138b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:32.151716 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-17c0f727-876a-4a77-a8e6-06d5ed36138b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:32.162824 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-17c0f727-876a-4a77-a8e6-06d5ed36138b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.256921 Jul 11 14:14:32.164101 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 71/137] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:31 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:33.182333 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-33381ccf-9414-461d-a8df-7734b847d5a9 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:33.182988 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-33381ccf-9414-461d-a8df-7734b847d5a9 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:33.191189 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-33381ccf-9414-461d-a8df-7734b847d5a9 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:33.191634 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-33381ccf-9414-461d-a8df-7734b847d5a9 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:33.192408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-33381ccf-9414-461d-a8df-7734b847d5a9 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:33.192851 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-33381ccf-9414-461d-a8df-7734b847d5a9 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:33.431576 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-33381ccf-9414-461d-a8df-7734b847d5a9 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:33.440127 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-33381ccf-9414-461d-a8df-7734b847d5a9 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.262765 Jul 11 14:14:33.441821 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 67/138] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:33 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:34.458898 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1d22b18d-d48f-4bab-88ad-5d1c69c78b8d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:34.461173 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1d22b18d-d48f-4bab-88ad-5d1c69c78b8d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:34.469272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d22b18d-d48f-4bab-88ad-5d1c69c78b8d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:34.470004 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d22b18d-d48f-4bab-88ad-5d1c69c78b8d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:34.471011 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d22b18d-d48f-4bab-88ad-5d1c69c78b8d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:34.471768 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d22b18d-d48f-4bab-88ad-5d1c69c78b8d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:34.811615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1d22b18d-d48f-4bab-88ad-5d1c69c78b8d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:34.826441 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1d22b18d-d48f-4bab-88ad-5d1c69c78b8d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.371489 Jul 11 14:14:34.838199 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 72/139] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:34 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:35.503099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-392f5b85-7461-4fb0-9d4e-573af86baef1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:35.503590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-392f5b85-7461-4fb0-9d4e-573af86baef1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:35.511357 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-392f5b85-7461-4fb0-9d4e-573af86baef1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:35.511822 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-392f5b85-7461-4fb0-9d4e-573af86baef1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:35.512575 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-392f5b85-7461-4fb0-9d4e-573af86baef1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:35.513007 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-392f5b85-7461-4fb0-9d4e-573af86baef1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:35.539168 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-392f5b85-7461-4fb0-9d4e-573af86baef1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:14:35.643844 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-392f5b85-7461-4fb0-9d4e-573af86baef1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 204 len: 0 microversion: 2.1 time: 0.144156 Jul 11 14:14:35.644779 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 68/140] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:14:35 2022] DELETE /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:14:35.656666 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8494ee2a-2e99-4152-90ae-f24d2600f5f5 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:35.656666 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8494ee2a-2e99-4152-90ae-f24d2600f5f5 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:35.664790 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8494ee2a-2e99-4152-90ae-f24d2600f5f5 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:35.665236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8494ee2a-2e99-4152-90ae-f24d2600f5f5 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:35.666234 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8494ee2a-2e99-4152-90ae-f24d2600f5f5 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:35.666656 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8494ee2a-2e99-4152-90ae-f24d2600f5f5 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:35.826837 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8494ee2a-2e99-4152-90ae-f24d2600f5f5 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:35.837235 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8494ee2a-2e99-4152-90ae-f24d2600f5f5 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1552 microversion: 2.1 time: 0.187137 Jul 11 14:14:35.837926 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 73/141] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:35 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1552 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:35.844932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-51768d18-dedf-4273-830f-dcdf3a6dd90d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:35.845634 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-51768d18-dedf-4273-830f-dcdf3a6dd90d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:35.857780 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51768d18-dedf-4273-830f-dcdf3a6dd90d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:35.858603 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51768d18-dedf-4273-830f-dcdf3a6dd90d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:35.859970 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51768d18-dedf-4273-830f-dcdf3a6dd90d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:35.860758 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51768d18-dedf-4273-830f-dcdf3a6dd90d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:36.031354 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-51768d18-dedf-4273-830f-dcdf3a6dd90d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:36.040258 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-51768d18-dedf-4273-830f-dcdf3a6dd90d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.199803 Jul 11 14:14:36.040904 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 69/142] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:35 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:36.855697 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4b9a92fd-6752-48f2-aae8-088c1bd4004e tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:36.857623 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4b9a92fd-6752-48f2-aae8-088c1bd4004e tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:36.867356 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b9a92fd-6752-48f2-aae8-088c1bd4004e tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:36.868288 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b9a92fd-6752-48f2-aae8-088c1bd4004e tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:36.869551 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b9a92fd-6752-48f2-aae8-088c1bd4004e tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:36.870579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b9a92fd-6752-48f2-aae8-088c1bd4004e tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:37.016298 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b9a92fd-6752-48f2-aae8-088c1bd4004e tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:37.027412 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4b9a92fd-6752-48f2-aae8-088c1bd4004e tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1552 microversion: 2.1 time: 0.175018 Jul 11 14:14:37.038038 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 74/143] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:36 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1552 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:37.058230 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5e8a26dd-27ee-4602-8d35-a8c49064f2d8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:37.058824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5e8a26dd-27ee-4602-8d35-a8c49064f2d8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:37.073043 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e8a26dd-27ee-4602-8d35-a8c49064f2d8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:37.073407 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e8a26dd-27ee-4602-8d35-a8c49064f2d8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:37.074369 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e8a26dd-27ee-4602-8d35-a8c49064f2d8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:37.074964 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e8a26dd-27ee-4602-8d35-a8c49064f2d8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:37.242630 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5e8a26dd-27ee-4602-8d35-a8c49064f2d8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:37.250673 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5e8a26dd-27ee-4602-8d35-a8c49064f2d8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.197424 Jul 11 14:14:37.251512 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 70/144] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:37 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:38.045742 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6d945975-be0b-4a27-b65c-54c571cdb9e1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:38.046438 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6d945975-be0b-4a27-b65c-54c571cdb9e1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:38.056858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d945975-be0b-4a27-b65c-54c571cdb9e1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:38.057719 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d945975-be0b-4a27-b65c-54c571cdb9e1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:38.058811 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d945975-be0b-4a27-b65c-54c571cdb9e1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:38.059630 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d945975-be0b-4a27-b65c-54c571cdb9e1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:38.271675 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a8f94b90-ebe9-46e9-8436-15be954ee863 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:38.272532 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a8f94b90-ebe9-46e9-8436-15be954ee863 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:38.283885 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a8f94b90-ebe9-46e9-8436-15be954ee863 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:38.284335 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a8f94b90-ebe9-46e9-8436-15be954ee863 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:38.285104 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a8f94b90-ebe9-46e9-8436-15be954ee863 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:38.285677 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a8f94b90-ebe9-46e9-8436-15be954ee863 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:38.328868 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6d945975-be0b-4a27-b65c-54c571cdb9e1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:38.341730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6d945975-be0b-4a27-b65c-54c571cdb9e1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1552 microversion: 2.1 time: 0.300596 Jul 11 14:14:38.355147 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 75/145] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:38 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1552 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:38.642615 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a8f94b90-ebe9-46e9-8436-15be954ee863 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:38.662689 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a8f94b90-ebe9-46e9-8436-15be954ee863 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.394851 Jul 11 14:14:38.663784 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 71/146] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:38 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:39.007154 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-86a60824-8f89-45dc-866f-1090f71dadbe req-513ef98c-c349-464d-bf40-8c2026da9497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b6aebc-3e65-4609-a344-61462c14e25d", "name": "network-vif-deleted", "tag": "5f3f18ed-2057-426c-9899-844263690d4b"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:14:39.026188 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-86a60824-8f89-45dc-866f-1090f71dadbe req-513ef98c-c349-464d-bf40-8c2026da9497 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:39.027610 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-86a60824-8f89-45dc-866f-1090f71dadbe req-513ef98c-c349-464d-bf40-8c2026da9497 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:39.062556 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-86a60824-8f89-45dc-866f-1090f71dadbe req-513ef98c-c349-464d-bf40-8c2026da9497 service nova] Creating event network-vif-deleted:5f3f18ed-2057-426c-9899-844263690d4b for instance a7b6aebc-3e65-4609-a344-61462c14e25d on hv-cinder-81914 Jul 11 14:14:39.072436 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-86a60824-8f89-45dc-866f-1090f71dadbe req-513ef98c-c349-464d-bf40-8c2026da9497 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066539 Jul 11 14:14:39.074758 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 76/147] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:14:39.188540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c9801fab-fb49-4590-adcd-3feb736ebd03 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1894798026", "imageRef": "67874ac7-fac8-4d6d-9cd1-9091ecb957b6", "flavorRef": "452"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:14:39.257358 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-c9801fab-fb49-4590-adcd-3feb736ebd03 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] validate_networks() for None {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:14:39.363838 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-80420f1f-719b-4a11-9613-9fd9b046fc20 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:39.365064 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-80420f1f-719b-4a11-9613-9fd9b046fc20 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:39.391734 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80420f1f-719b-4a11-9613-9fd9b046fc20 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:39.392203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80420f1f-719b-4a11-9613-9fd9b046fc20 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:39.393014 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80420f1f-719b-4a11-9613-9fd9b046fc20 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:39.393452 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80420f1f-719b-4a11-9613-9fd9b046fc20 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:39.514580 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-80420f1f-719b-4a11-9613-9fd9b046fc20 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f62561a96f471b9dcc660e7aa9ff60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76680cc3cbbf45328e05bee398de20de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:39.541942 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-80420f1f-719b-4a11-9613-9fd9b046fc20 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 200 len: 1345 microversion: 2.1 time: 0.183619 Jul 11 14:14:39.554089 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 77/148] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:39 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 1345 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:39.662393 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-c9801fab-fb49-4590-adcd-3feb736ebd03 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:14:39.663420 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-c9801fab-fb49-4590-adcd-3feb736ebd03 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:14:39.664217 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-c9801fab-fb49-4590-adcd-3feb736ebd03 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:14:39.664767 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-c9801fab-fb49-4590-adcd-3feb736ebd03 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:14:39.665693 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-c9801fab-fb49-4590-adcd-3feb736ebd03 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:14:39.676653 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c9801fab-fb49-4590-adcd-3feb736ebd03 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:39.677152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c9801fab-fb49-4590-adcd-3feb736ebd03 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:39.677985 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c9801fab-fb49-4590-adcd-3feb736ebd03 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:39.678451 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c9801fab-fb49-4590-adcd-3feb736ebd03 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:39.682339 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ad593ff4-d4c7-4698-a3d6-75927169286c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:39.682838 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ad593ff4-d4c7-4698-a3d6-75927169286c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:39.689353 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad593ff4-d4c7-4698-a3d6-75927169286c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:39.689889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad593ff4-d4c7-4698-a3d6-75927169286c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:39.697602 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad593ff4-d4c7-4698-a3d6-75927169286c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:39.698094 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad593ff4-d4c7-4698-a3d6-75927169286c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:39.728206 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-c9801fab-fb49-4590-adcd-3feb736ebd03 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Getting quotas for project bc773c1e59304cf58c89bfd6707b7ec0. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:14:39.740853 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-c9801fab-fb49-4590-adcd-3feb736ebd03 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Getting quotas for user e7bd87bcd9b148d899ceb09f9f311ad0 and project bc773c1e59304cf58c89bfd6707b7ec0. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:14:39.765397 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c9801fab-fb49-4590-adcd-3feb736ebd03 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:14:39.779383 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c9801fab-fb49-4590-adcd-3feb736ebd03 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67874ac7-fac8-4d6d-9cd1-9091ecb957b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:14:39.864339 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c9801fab-fb49-4590-adcd-3feb736ebd03 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679356 Jul 11 14:14:39.865636 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 72/149] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:14:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:14:39.877602 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9a9ad365-2742-44eb-ad13-a4587f889f58 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:39.881885 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9a9ad365-2742-44eb-ad13-a4587f889f58 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:39.985297 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ad593ff4-d4c7-4698-a3d6-75927169286c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:39.994975 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9a9ad365-2742-44eb-ad13-a4587f889f58 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:40.003113 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ad593ff4-d4c7-4698-a3d6-75927169286c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.322411 Jul 11 14:14:40.011033 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 78/150] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:39 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:40.012451 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9a9ad365-2742-44eb-ad13-a4587f889f58 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1215 microversion: 2.1 time: 0.132473 Jul 11 14:14:40.015945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 73/151] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:39 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:40.571452 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3447c6a0-0e7d-4994-b967-0973b72667c7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:40.572802 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3447c6a0-0e7d-4994-b967-0973b72667c7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:40.581527 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3447c6a0-0e7d-4994-b967-0973b72667c7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:40.582974 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3447c6a0-0e7d-4994-b967-0973b72667c7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:40.584914 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3447c6a0-0e7d-4994-b967-0973b72667c7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:40.587066 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3447c6a0-0e7d-4994-b967-0973b72667c7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:40.605101 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-3447c6a0-0e7d-4994-b967-0973b72667c7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] HTTP exception thrown: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3447c6a0-0e7d-4994-b967-0973b72667c7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Request method failure captured: Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d HTTP/1.1 Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDAIq1rQZJIc4Ievu3KicNmm059DhhymliHCPo4nS-pgT9Q98VFeIr_qJSU4DCvOSq4MRh5tJPqJvt0vBMDTowbLb3GvgscKm8VRTpq7U8lB5YVQ_5nsjAuMq0bLSwEbGZYpw1AUak7jLd6Xx97b3CTbZWcupfKleWL573k-o6yFhMc Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 76680cc3cbbf45328e05bee398de20de Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-DeleteServersTestJSON-1772253976 Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:14:40.621338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:14:40.622882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_76680cc3cbbf45328e05bee398de20de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/76680cc3cbbf45328e05bee398de20de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/76680cc3cbbf45328e05bee398de20de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/76680cc3cbbf45328e05bee398de20de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:14:40.622882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-DeleteServersTestJSON-1772253976 Jul 11 14:14:40.622882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 76680cc3cbbf45328e05bee398de20de Jul 11 14:14:40.622882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1772253976 Jul 11 14:14:40.622882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-DeleteServersTestJSON-1772253976-project Jul 11 14:14:40.622882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:14:40.622882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:14:40.622882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 75f62561a96f471b9dcc660e7aa9ff60 Jul 11 14:14:40.622882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-DeleteServersTestJSON-1772253976-project Jul 11 14:14:40.622882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:14:40.622882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:40.622882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': 'a7b6aebc-3e65-4609-a344-61462c14e25d'} Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:14:40.623751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:14:40.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:14:40.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:14:40.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:14:40.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:14:40.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:14:40.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:14:40.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:14:40.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:40.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:14:40.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:14:40.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:14:40.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:14:40.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:14:40.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:14:40.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:14:40.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:14:40.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:40.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:14:40.628197 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3447c6a0-0e7d-4994-b967-0973b72667c7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Returning 404 to user: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:14:40.631714 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3447c6a0-0e7d-4994-b967-0973b72667c7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 404 len: 111 microversion: 2.1 time: 0.069124 Jul 11 14:14:40.632692 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 79/152] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:40 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:14:40.853611 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5bf91117-2fb5-4746-9b96-f3bedbc7b4e7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:40.855594 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5bf91117-2fb5-4746-9b96-f3bedbc7b4e7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:40.862923 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5bf91117-2fb5-4746-9b96-f3bedbc7b4e7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:40.864477 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5bf91117-2fb5-4746-9b96-f3bedbc7b4e7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:40.865448 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5bf91117-2fb5-4746-9b96-f3bedbc7b4e7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:40.866041 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5bf91117-2fb5-4746-9b96-f3bedbc7b4e7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:40.882874 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-5bf91117-2fb5-4746-9b96-f3bedbc7b4e7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] HTTP exception thrown: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5bf91117-2fb5-4746-9b96-f3bedbc7b4e7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Request method failure captured: Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d/os-volume_attachments HTTP/1.1 Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDAIq1rQZJIc4Ievu3KicNmm059DhhymliHCPo4nS-pgT9Q98VFeIr_qJSU4DCvOSq4MRh5tJPqJvt0vBMDTowbLb3GvgscKm8VRTpq7U8lB5YVQ_5nsjAuMq0bLSwEbGZYpw1AUak7jLd6Xx97b3CTbZWcupfKleWL573k-o6yFhMc Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 76680cc3cbbf45328e05bee398de20de Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-DeleteServersTestJSON-1772253976 Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:14:40.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:14:40.902055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_76680cc3cbbf45328e05bee398de20de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/76680cc3cbbf45328e05bee398de20de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/76680cc3cbbf45328e05bee398de20de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/76680cc3cbbf45328e05bee398de20de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:14:40.902055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-DeleteServersTestJSON-1772253976 Jul 11 14:14:40.902055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 76680cc3cbbf45328e05bee398de20de Jul 11 14:14:40.902055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-DeleteServersTestJSON-1772253976 Jul 11 14:14:40.902055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-DeleteServersTestJSON-1772253976-project Jul 11 14:14:40.902055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:14:40.902055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:14:40.902055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 75f62561a96f471b9dcc660e7aa9ff60 Jul 11 14:14:40.902055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-DeleteServersTestJSON-1772253976-project Jul 11 14:14:40.902055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:14:40.902055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:40.902055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'server_id': 'a7b6aebc-3e65-4609-a344-61462c14e25d'} Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:14:40.902912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:40.904152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:14:40.906907 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5bf91117-2fb5-4746-9b96-f3bedbc7b4e7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Returning 404 to user: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:14:40.908425 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5bf91117-2fb5-4746-9b96-f3bedbc7b4e7 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.059304 Jul 11 14:14:40.910241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 74/153] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:14:40 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d/os-volume_attachments => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:14:41.025847 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b9f7c915-531e-44a9-be3b-731384027716 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:41.026724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b9f7c915-531e-44a9-be3b-731384027716 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:41.037333 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6eac349a-5ca0-490d-8083-92d731fb7949 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:41.037983 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6eac349a-5ca0-490d-8083-92d731fb7949 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:41.051796 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9f7c915-531e-44a9-be3b-731384027716 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:41.052243 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9f7c915-531e-44a9-be3b-731384027716 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:41.053026 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9f7c915-531e-44a9-be3b-731384027716 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:41.053283 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6eac349a-5ca0-490d-8083-92d731fb7949 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:41.053736 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6eac349a-5ca0-490d-8083-92d731fb7949 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:41.054825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6eac349a-5ca0-490d-8083-92d731fb7949 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:41.055259 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6eac349a-5ca0-490d-8083-92d731fb7949 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:41.058836 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9f7c915-531e-44a9-be3b-731384027716 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:41.115804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:41.180634 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6eac349a-5ca0-490d-8083-92d731fb7949 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:41.195835 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6eac349a-5ca0-490d-8083-92d731fb7949 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1267 microversion: 2.1 time: 0.159783 Jul 11 14:14:41.206206 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 75/154] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:41 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:41.328920 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b9f7c915-531e-44a9-be3b-731384027716 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:41.338443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b9f7c915-531e-44a9-be3b-731384027716 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.318329 Jul 11 14:14:41.338443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 80/155] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:41 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:42.212929 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-96166c8f-0970-42c8-a262-6097fd85e42e tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:42.213548 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-96166c8f-0970-42c8-a262-6097fd85e42e tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:42.220098 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-96166c8f-0970-42c8-a262-6097fd85e42e tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:42.220781 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-96166c8f-0970-42c8-a262-6097fd85e42e tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:42.221805 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-96166c8f-0970-42c8-a262-6097fd85e42e tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:42.222610 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-96166c8f-0970-42c8-a262-6097fd85e42e tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:42.310543 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1fd4406d-9028-443e-90fb-0a940eeb49c1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:42.311663 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1fd4406d-9028-443e-90fb-0a940eeb49c1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:42.319486 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1fd4406d-9028-443e-90fb-0a940eeb49c1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:42.320149 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1fd4406d-9028-443e-90fb-0a940eeb49c1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:42.321106 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1fd4406d-9028-443e-90fb-0a940eeb49c1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:42.321717 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1fd4406d-9028-443e-90fb-0a940eeb49c1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:42.321833 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-96166c8f-0970-42c8-a262-6097fd85e42e tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:42.333157 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-96166c8f-0970-42c8-a262-6097fd85e42e tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1273 microversion: 2.1 time: 0.123500 Jul 11 14:14:42.343506 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 76/156] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:42 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1273 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-1fd4406d-9028-443e-90fb-0a940eeb49c1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] HTTP exception thrown: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1fd4406d-9028-443e-90fb-0a940eeb49c1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Request method failure captured: Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d HTTP/1.1 Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDAIq1rQZJIc4Ievu3KicNmm059DhhymliHCPo4nS-pgT9Q98VFeIr_qJSU4DCvOSq4MRh5tJPqJvt0vBMDTowbLb3GvgscKm8VRTpq7U8lB5YVQ_5nsjAuMq0bLSwEbGZYpw1AUak7jLd6Xx97b3CTbZWcupfKleWL573k-o6yFhMc Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 76680cc3cbbf45328e05bee398de20de Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-DeleteServersTestJSON-1772253976 Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:14:42.344044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:14:42.345443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_76680cc3cbbf45328e05bee398de20de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/76680cc3cbbf45328e05bee398de20de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/76680cc3cbbf45328e05bee398de20de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/76680cc3cbbf45328e05bee398de20de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:14:42.345443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-DeleteServersTestJSON-1772253976 Jul 11 14:14:42.345443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 76680cc3cbbf45328e05bee398de20de Jul 11 14:14:42.345443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1772253976 Jul 11 14:14:42.345443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-DeleteServersTestJSON-1772253976-project Jul 11 14:14:42.345443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:14:42.345443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:14:42.345443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 75f62561a96f471b9dcc660e7aa9ff60 Jul 11 14:14:42.345443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-DeleteServersTestJSON-1772253976-project Jul 11 14:14:42.345443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:14:42.345443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:42.345443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': 'a7b6aebc-3e65-4609-a344-61462c14e25d'} Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:14:42.346370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:42.347701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:14:42.349538 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1fd4406d-9028-443e-90fb-0a940eeb49c1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Returning 404 to user: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:14:42.349538 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1fd4406d-9028-443e-90fb-0a940eeb49c1 tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 404 len: 111 microversion: 2.1 time: 0.035739 Jul 11 14:14:42.349538 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 81/157] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:14:42 2022] DELETE /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 14:14:42.360768 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2e4020ee-a09b-4959-a594-099286ab137b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:42.361001 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ba06a03c-8c9d-44c8-beb1-1241fb148a0b tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:42.361387 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2e4020ee-a09b-4959-a594-099286ab137b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:42.361498 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ba06a03c-8c9d-44c8-beb1-1241fb148a0b tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] [instance: a7b6aebc-3e65-4609-a344-61462c14e25d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:42.377564 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e4020ee-a09b-4959-a594-099286ab137b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:42.378202 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e4020ee-a09b-4959-a594-099286ab137b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:42.379121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e4020ee-a09b-4959-a594-099286ab137b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:42.379759 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e4020ee-a09b-4959-a594-099286ab137b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:42.382118 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ba06a03c-8c9d-44c8-beb1-1241fb148a0b tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:42.382596 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ba06a03c-8c9d-44c8-beb1-1241fb148a0b tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:42.383697 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ba06a03c-8c9d-44c8-beb1-1241fb148a0b tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:42.384139 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ba06a03c-8c9d-44c8-beb1-1241fb148a0b tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:42.414839 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-ba06a03c-8c9d-44c8-beb1-1241fb148a0b tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] HTTP exception thrown: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ba06a03c-8c9d-44c8-beb1-1241fb148a0b tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Request method failure captured: Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d HTTP/1.1 Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDAIq1rQZJIc4Ievu3KicNmm059DhhymliHCPo4nS-pgT9Q98VFeIr_qJSU4DCvOSq4MRh5tJPqJvt0vBMDTowbLb3GvgscKm8VRTpq7U8lB5YVQ_5nsjAuMq0bLSwEbGZYpw1AUak7jLd6Xx97b3CTbZWcupfKleWL573k-o6yFhMc Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 76680cc3cbbf45328e05bee398de20de Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-DeleteServersTestJSON-1772253976 Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:14:42.423113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:14:42.424747 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_76680cc3cbbf45328e05bee398de20de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/76680cc3cbbf45328e05bee398de20de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/76680cc3cbbf45328e05bee398de20de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/76680cc3cbbf45328e05bee398de20de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:14:42.424747 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-DeleteServersTestJSON-1772253976 Jul 11 14:14:42.424747 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 76680cc3cbbf45328e05bee398de20de Jul 11 14:14:42.424747 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-DeleteServersTestJSON-1772253976 Jul 11 14:14:42.424747 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-DeleteServersTestJSON-1772253976-project Jul 11 14:14:42.424747 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:14:42.424747 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:14:42.424747 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 75f62561a96f471b9dcc660e7aa9ff60 Jul 11 14:14:42.424747 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-DeleteServersTestJSON-1772253976-project Jul 11 14:14:42.424747 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:14:42.424747 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:42.424747 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': 'a7b6aebc-3e65-4609-a344-61462c14e25d'} Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:14:42.425590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:14:42.427712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:14:42.427712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:14:42.427712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:14:42.427712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:14:42.427712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:14:42.427712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:14:42.427712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:14:42.427712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:42.427712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:14:42.427712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:14:42.427712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:14:42.427712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:14:42.427712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:14:42.427712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:14:42.427712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:14:42.427712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:14:42.427712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. Jul 11 14:14:42.427712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:14:42.430020 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ba06a03c-8c9d-44c8-beb1-1241fb148a0b tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] Returning 404 to user: Instance a7b6aebc-3e65-4609-a344-61462c14e25d could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:14:42.431231 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ba06a03c-8c9d-44c8-beb1-1241fb148a0b tempest-DeleteServersTestJSON-1772253976 tempest-DeleteServersTestJSON-1772253976-project] 10.222.0.66 "GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d" status: 404 len: 111 microversion: 2.1 time: 0.075470 Jul 11 14:14:42.432326 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 77/158] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:42 2022] GET /compute/v2.1/servers/a7b6aebc-3e65-4609-a344-61462c14e25d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:14:42.575625 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2e4020ee-a09b-4959-a594-099286ab137b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:42.588254 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2e4020ee-a09b-4959-a594-099286ab137b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.231078 Jul 11 14:14:42.589183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 82/159] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:42 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:43.350876 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8dd4b213-074e-414a-a3d1-ebebb645f06d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:43.351488 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8dd4b213-074e-414a-a3d1-ebebb645f06d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:43.357739 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8dd4b213-074e-414a-a3d1-ebebb645f06d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:43.358210 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8dd4b213-074e-414a-a3d1-ebebb645f06d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:43.359164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8dd4b213-074e-414a-a3d1-ebebb645f06d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:43.359587 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8dd4b213-074e-414a-a3d1-ebebb645f06d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:43.583789 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8dd4b213-074e-414a-a3d1-ebebb645f06d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:43.593275 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8dd4b213-074e-414a-a3d1-ebebb645f06d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1315 microversion: 2.1 time: 0.246218 Jul 11 14:14:43.594321 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 78/160] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:43 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:43.608030 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4cdb3078-708f-49f4-98fd-cc6220323a64 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:43.609243 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4cdb3078-708f-49f4-98fd-cc6220323a64 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:43.616231 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4cdb3078-708f-49f4-98fd-cc6220323a64 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:43.616926 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4cdb3078-708f-49f4-98fd-cc6220323a64 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:43.617847 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4cdb3078-708f-49f4-98fd-cc6220323a64 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:43.618448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4cdb3078-708f-49f4-98fd-cc6220323a64 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:43.809434 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4cdb3078-708f-49f4-98fd-cc6220323a64 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:43.818267 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4cdb3078-708f-49f4-98fd-cc6220323a64 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.213392 Jul 11 14:14:43.829604 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 83/161] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:43 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:44.611937 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-196efc9c-d0a2-4c3d-8a25-168d692b6ba6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:44.614118 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-196efc9c-d0a2-4c3d-8a25-168d692b6ba6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:44.622729 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-196efc9c-d0a2-4c3d-8a25-168d692b6ba6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:44.623644 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-196efc9c-d0a2-4c3d-8a25-168d692b6ba6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:44.624528 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-196efc9c-d0a2-4c3d-8a25-168d692b6ba6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:44.625061 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-196efc9c-d0a2-4c3d-8a25-168d692b6ba6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:44.837382 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a53cbd73-3323-498c-96dd-710606fe09d6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:44.838314 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a53cbd73-3323-498c-96dd-710606fe09d6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:44.845763 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a53cbd73-3323-498c-96dd-710606fe09d6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:44.846380 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a53cbd73-3323-498c-96dd-710606fe09d6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:44.847240 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a53cbd73-3323-498c-96dd-710606fe09d6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:44.848493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a53cbd73-3323-498c-96dd-710606fe09d6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:45.031707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a53cbd73-3323-498c-96dd-710606fe09d6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:45.041799 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a53cbd73-3323-498c-96dd-710606fe09d6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.209817 Jul 11 14:14:45.044117 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 84/162] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:44 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:45.110865 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-196efc9c-d0a2-4c3d-8a25-168d692b6ba6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:45.125340 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-196efc9c-d0a2-4c3d-8a25-168d692b6ba6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1315 microversion: 2.1 time: 0.517060 Jul 11 14:14:45.127561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 79/163] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:44 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:46.060940 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-66b0d721-a2ce-4859-8c88-2e707d4ef00f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:46.061624 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-66b0d721-a2ce-4859-8c88-2e707d4ef00f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:46.069729 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-66b0d721-a2ce-4859-8c88-2e707d4ef00f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:46.070444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-66b0d721-a2ce-4859-8c88-2e707d4ef00f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:46.071385 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-66b0d721-a2ce-4859-8c88-2e707d4ef00f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:46.071980 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-66b0d721-a2ce-4859-8c88-2e707d4ef00f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:46.145470 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4374d0f8-fdfa-41b9-8e6a-01c5c3665535 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:46.146777 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4374d0f8-fdfa-41b9-8e6a-01c5c3665535 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:46.161484 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:46.166456 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4374d0f8-fdfa-41b9-8e6a-01c5c3665535 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:46.167755 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4374d0f8-fdfa-41b9-8e6a-01c5c3665535 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:46.169009 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4374d0f8-fdfa-41b9-8e6a-01c5c3665535 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:46.169741 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4374d0f8-fdfa-41b9-8e6a-01c5c3665535 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:46.267529 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-66b0d721-a2ce-4859-8c88-2e707d4ef00f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:46.277889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-66b0d721-a2ce-4859-8c88-2e707d4ef00f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.220691 Jul 11 14:14:46.278834 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 85/164] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:46 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:46.577596 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4374d0f8-fdfa-41b9-8e6a-01c5c3665535 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:46.586287 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4374d0f8-fdfa-41b9-8e6a-01c5c3665535 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1315 microversion: 2.1 time: 0.445496 Jul 11 14:14:46.586904 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 80/165] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:46 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:46.638410 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-d10ef4b8-3e95-4ca6-a8ff-97be82b52ac9 req-f285414d-3794-4bad-bf26-0df24287ee6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baa1201b-404f-43ee-ab93-303f01d18897", "tag": "35760169-c7ed-48e3-99e9-367bbd2965e0"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:14:46.650681 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d10ef4b8-3e95-4ca6-a8ff-97be82b52ac9 req-f285414d-3794-4bad-bf26-0df24287ee6f service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:46.651037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d10ef4b8-3e95-4ca6-a8ff-97be82b52ac9 req-f285414d-3794-4bad-bf26-0df24287ee6f service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:46.666995 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-d10ef4b8-3e95-4ca6-a8ff-97be82b52ac9 req-f285414d-3794-4bad-bf26-0df24287ee6f service nova] Creating event network-changed:35760169-c7ed-48e3-99e9-367bbd2965e0 for instance baa1201b-404f-43ee-ab93-303f01d18897 on hv-cinder-81914 Jul 11 14:14:46.676904 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-d10ef4b8-3e95-4ca6-a8ff-97be82b52ac9 req-f285414d-3794-4bad-bf26-0df24287ee6f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042565 Jul 11 14:14:46.678297 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 86/166] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:14:47.295705 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bdf7a617-58f7-4708-9f69-b3aa10772c40 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:47.296329 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bdf7a617-58f7-4708-9f69-b3aa10772c40 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:47.304048 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bdf7a617-58f7-4708-9f69-b3aa10772c40 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:47.304522 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bdf7a617-58f7-4708-9f69-b3aa10772c40 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:47.305292 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bdf7a617-58f7-4708-9f69-b3aa10772c40 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:47.305911 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bdf7a617-58f7-4708-9f69-b3aa10772c40 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:47.480141 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bdf7a617-58f7-4708-9f69-b3aa10772c40 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:47.497874 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bdf7a617-58f7-4708-9f69-b3aa10772c40 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.205746 Jul 11 14:14:47.500100 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 81/167] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:47 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:47.609257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-501ac23f-3151-487a-bf08-6f720babe025 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:47.610912 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-501ac23f-3151-487a-bf08-6f720babe025 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:47.617823 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-501ac23f-3151-487a-bf08-6f720babe025 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:47.618302 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-501ac23f-3151-487a-bf08-6f720babe025 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:47.619133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-501ac23f-3151-487a-bf08-6f720babe025 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:47.619737 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-501ac23f-3151-487a-bf08-6f720babe025 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:47.859349 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-501ac23f-3151-487a-bf08-6f720babe025 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:47.869475 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-501ac23f-3151-487a-bf08-6f720babe025 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1315 microversion: 2.1 time: 0.268217 Jul 11 14:14:47.870729 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 87/168] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:47 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:48.519999 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e007ba6f-bfe7-4a16-a860-5df777c6a1c0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:48.520636 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e007ba6f-bfe7-4a16-a860-5df777c6a1c0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:48.528386 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e007ba6f-bfe7-4a16-a860-5df777c6a1c0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:48.528844 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e007ba6f-bfe7-4a16-a860-5df777c6a1c0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:48.529628 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e007ba6f-bfe7-4a16-a860-5df777c6a1c0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:48.530064 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e007ba6f-bfe7-4a16-a860-5df777c6a1c0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:48.678034 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e007ba6f-bfe7-4a16-a860-5df777c6a1c0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:48.685868 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e007ba6f-bfe7-4a16-a860-5df777c6a1c0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.170385 Jul 11 14:14:48.686509 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 82/169] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:48 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:48.886621 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6d8599ce-d1bb-4c1f-bf80-a1342310a743 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:48.887240 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6d8599ce-d1bb-4c1f-bf80-a1342310a743 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:48.896343 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d8599ce-d1bb-4c1f-bf80-a1342310a743 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:48.897068 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d8599ce-d1bb-4c1f-bf80-a1342310a743 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:48.898188 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d8599ce-d1bb-4c1f-bf80-a1342310a743 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:48.898767 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d8599ce-d1bb-4c1f-bf80-a1342310a743 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:49.040586 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6d8599ce-d1bb-4c1f-bf80-a1342310a743 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:49.049386 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6d8599ce-d1bb-4c1f-bf80-a1342310a743 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1315 microversion: 2.1 time: 0.166589 Jul 11 14:14:49.049972 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 88/170] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:48 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:49.704980 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-abefabc2-f7e5-45ce-9f2a-f92d9a3367e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:49.705671 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-abefabc2-f7e5-45ce-9f2a-f92d9a3367e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:49.709603 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:49.714228 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-abefabc2-f7e5-45ce-9f2a-f92d9a3367e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:49.714673 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-abefabc2-f7e5-45ce-9f2a-f92d9a3367e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:49.715453 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-abefabc2-f7e5-45ce-9f2a-f92d9a3367e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:49.715888 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-abefabc2-f7e5-45ce-9f2a-f92d9a3367e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:49.867207 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-abefabc2-f7e5-45ce-9f2a-f92d9a3367e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:49.874812 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-abefabc2-f7e5-45ce-9f2a-f92d9a3367e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.174694 Jul 11 14:14:49.875397 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 83/171] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:49 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:50.068222 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3fe2000f-ba91-4634-8735-8bf356286cf9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:50.068853 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3fe2000f-ba91-4634-8735-8bf356286cf9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:50.077894 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fe2000f-ba91-4634-8735-8bf356286cf9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:50.079732 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fe2000f-ba91-4634-8735-8bf356286cf9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:50.080876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fe2000f-ba91-4634-8735-8bf356286cf9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:50.081636 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fe2000f-ba91-4634-8735-8bf356286cf9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:50.088021 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:50.255277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3fe2000f-ba91-4634-8735-8bf356286cf9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:50.264617 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3fe2000f-ba91-4634-8735-8bf356286cf9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1315 microversion: 2.1 time: 0.201462 Jul 11 14:14:50.265357 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 89/172] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:50 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:50.897750 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a28f312b-39a4-4f5b-9214-ae3c4e968093 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:50.898476 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a28f312b-39a4-4f5b-9214-ae3c4e968093 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:50.901395 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=8 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:50.905475 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a28f312b-39a4-4f5b-9214-ae3c4e968093 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:50.905919 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a28f312b-39a4-4f5b-9214-ae3c4e968093 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:50.906717 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a28f312b-39a4-4f5b-9214-ae3c4e968093 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:50.907152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a28f312b-39a4-4f5b-9214-ae3c4e968093 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:51.039310 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a28f312b-39a4-4f5b-9214-ae3c4e968093 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:51.046767 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a28f312b-39a4-4f5b-9214-ae3c4e968093 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.153528 Jul 11 14:14:51.047336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 84/173] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:50 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:51.281775 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d2ae814a-7770-492f-a8de-a426fe54b7bd tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:51.282448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d2ae814a-7770-492f-a8de-a426fe54b7bd tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:51.289562 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d2ae814a-7770-492f-a8de-a426fe54b7bd tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:51.290010 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d2ae814a-7770-492f-a8de-a426fe54b7bd tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:51.290947 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d2ae814a-7770-492f-a8de-a426fe54b7bd tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:51.291389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d2ae814a-7770-492f-a8de-a426fe54b7bd tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:51.435417 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d2ae814a-7770-492f-a8de-a426fe54b7bd tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:51.443683 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d2ae814a-7770-492f-a8de-a426fe54b7bd tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1315 microversion: 2.1 time: 0.165722 Jul 11 14:14:51.444268 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 90/174] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:51 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:52.064234 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-86b1582a-4b4a-4ec4-a174-3191a479ce94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:52.064756 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-86b1582a-4b4a-4ec4-a174-3191a479ce94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:52.071111 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86b1582a-4b4a-4ec4-a174-3191a479ce94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:52.071560 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86b1582a-4b4a-4ec4-a174-3191a479ce94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:52.072346 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86b1582a-4b4a-4ec4-a174-3191a479ce94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:52.072827 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86b1582a-4b4a-4ec4-a174-3191a479ce94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:52.201629 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-86b1582a-4b4a-4ec4-a174-3191a479ce94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:52.209207 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-86b1582a-4b4a-4ec4-a174-3191a479ce94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.148950 Jul 11 14:14:52.209786 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 85/175] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:52 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:52.460433 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ddc9e262-42b4-4017-961b-b4319982109a tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:52.461054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ddc9e262-42b4-4017-961b-b4319982109a tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:52.467700 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ddc9e262-42b4-4017-961b-b4319982109a tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:52.468150 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ddc9e262-42b4-4017-961b-b4319982109a tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:52.468920 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ddc9e262-42b4-4017-961b-b4319982109a tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:52.469354 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ddc9e262-42b4-4017-961b-b4319982109a tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:52.604506 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ddc9e262-42b4-4017-961b-b4319982109a tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:52.612124 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ddc9e262-42b4-4017-961b-b4319982109a tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1315 microversion: 2.1 time: 0.156261 Jul 11 14:14:52.612696 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 91/176] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:52 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:53.229707 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3db034b0-af3e-4cfa-88eb-9704449d3a85 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:53.230348 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3db034b0-af3e-4cfa-88eb-9704449d3a85 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:53.236282 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3db034b0-af3e-4cfa-88eb-9704449d3a85 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:53.236649 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3db034b0-af3e-4cfa-88eb-9704449d3a85 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:53.237403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3db034b0-af3e-4cfa-88eb-9704449d3a85 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:53.238374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3db034b0-af3e-4cfa-88eb-9704449d3a85 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:53.373258 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3db034b0-af3e-4cfa-88eb-9704449d3a85 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:53.382447 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3db034b0-af3e-4cfa-88eb-9704449d3a85 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.156418 Jul 11 14:14:53.383030 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 86/177] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:53 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:53.628756 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-76f7f853-bf01-4d43-8f51-cdb361c8925d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:53.629471 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-76f7f853-bf01-4d43-8f51-cdb361c8925d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:53.637138 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76f7f853-bf01-4d43-8f51-cdb361c8925d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:53.637590 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76f7f853-bf01-4d43-8f51-cdb361c8925d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:53.638400 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76f7f853-bf01-4d43-8f51-cdb361c8925d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:53.638834 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76f7f853-bf01-4d43-8f51-cdb361c8925d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:53.779692 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-76f7f853-bf01-4d43-8f51-cdb361c8925d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:53.788036 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-76f7f853-bf01-4d43-8f51-cdb361c8925d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1315 microversion: 2.1 time: 0.163154 Jul 11 14:14:53.788660 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 92/178] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:53 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:54.400291 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b6a57a9c-bdf6-4b2c-91e9-089f9bb8d001 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:54.401291 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b6a57a9c-bdf6-4b2c-91e9-089f9bb8d001 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:54.408686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b6a57a9c-bdf6-4b2c-91e9-089f9bb8d001 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:54.409504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b6a57a9c-bdf6-4b2c-91e9-089f9bb8d001 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:54.410905 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b6a57a9c-bdf6-4b2c-91e9-089f9bb8d001 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:54.411459 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b6a57a9c-bdf6-4b2c-91e9-089f9bb8d001 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:54.689909 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b6a57a9c-bdf6-4b2c-91e9-089f9bb8d001 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:54.702665 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b6a57a9c-bdf6-4b2c-91e9-089f9bb8d001 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.306613 Jul 11 14:14:54.703266 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 87/179] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:54 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:54.809686 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3a74110d-7721-4272-8cec-56f0c9428f0f tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:54.810490 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3a74110d-7721-4272-8cec-56f0c9428f0f tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:54.817957 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a74110d-7721-4272-8cec-56f0c9428f0f tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:54.818595 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a74110d-7721-4272-8cec-56f0c9428f0f tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:54.819340 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a74110d-7721-4272-8cec-56f0c9428f0f tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:54.821313 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a74110d-7721-4272-8cec-56f0c9428f0f tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:55.104688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3a74110d-7721-4272-8cec-56f0c9428f0f tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:55.113432 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3a74110d-7721-4272-8cec-56f0c9428f0f tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1315 microversion: 2.1 time: 0.308586 Jul 11 14:14:55.114363 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 93/180] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:54 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:55.720868 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-505aaefd-8275-41e5-a978-c5bef0114e65 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:55.721501 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-505aaefd-8275-41e5-a978-c5bef0114e65 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:55.728223 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-505aaefd-8275-41e5-a978-c5bef0114e65 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:55.728682 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-505aaefd-8275-41e5-a978-c5bef0114e65 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:55.729463 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-505aaefd-8275-41e5-a978-c5bef0114e65 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:55.729900 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-505aaefd-8275-41e5-a978-c5bef0114e65 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:55.882876 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-505aaefd-8275-41e5-a978-c5bef0114e65 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:55.891125 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-505aaefd-8275-41e5-a978-c5bef0114e65 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.174189 Jul 11 14:14:55.891741 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 88/181] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:55 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:56.134267 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4a1b70ac-5142-4a2e-8c2b-dac0d30327b5 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:56.137299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4a1b70ac-5142-4a2e-8c2b-dac0d30327b5 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:56.152534 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4a1b70ac-5142-4a2e-8c2b-dac0d30327b5 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:56.156652 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4a1b70ac-5142-4a2e-8c2b-dac0d30327b5 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:56.157913 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4a1b70ac-5142-4a2e-8c2b-dac0d30327b5 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:56.158582 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4a1b70ac-5142-4a2e-8c2b-dac0d30327b5 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:56.357073 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4a1b70ac-5142-4a2e-8c2b-dac0d30327b5 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:56.367665 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4a1b70ac-5142-4a2e-8c2b-dac0d30327b5 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1315 microversion: 2.1 time: 0.239109 Jul 11 14:14:56.377904 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 94/182] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:56 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:56.912133 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-69192b6c-7c0b-4917-9947-6cb1c87c5703 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:56.913574 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-69192b6c-7c0b-4917-9947-6cb1c87c5703 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:56.919999 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-69192b6c-7c0b-4917-9947-6cb1c87c5703 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:56.920450 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-69192b6c-7c0b-4917-9947-6cb1c87c5703 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:56.921256 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-69192b6c-7c0b-4917-9947-6cb1c87c5703 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:56.921694 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-69192b6c-7c0b-4917-9947-6cb1c87c5703 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:57.059401 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-69192b6c-7c0b-4917-9947-6cb1c87c5703 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:57.068005 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-69192b6c-7c0b-4917-9947-6cb1c87c5703 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.159807 Jul 11 14:14:57.069356 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 89/183] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:56 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:57.384735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4af5d1ea-4245-4071-93af-1a585d6e3bc7 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:57.386688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4af5d1ea-4245-4071-93af-1a585d6e3bc7 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:57.400578 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4af5d1ea-4245-4071-93af-1a585d6e3bc7 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:57.401048 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4af5d1ea-4245-4071-93af-1a585d6e3bc7 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:57.403681 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4af5d1ea-4245-4071-93af-1a585d6e3bc7 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:57.404199 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4af5d1ea-4245-4071-93af-1a585d6e3bc7 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:57.565311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4af5d1ea-4245-4071-93af-1a585d6e3bc7 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:57.573224 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4af5d1ea-4245-4071-93af-1a585d6e3bc7 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1315 microversion: 2.1 time: 0.192523 Jul 11 14:14:57.573849 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 95/184] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:57 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:58.085193 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-56746754-e733-4c90-a77a-8973fed9a339 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:58.086014 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-56746754-e733-4c90-a77a-8973fed9a339 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:58.094283 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-56746754-e733-4c90-a77a-8973fed9a339 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:58.094738 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-56746754-e733-4c90-a77a-8973fed9a339 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:58.095631 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-56746754-e733-4c90-a77a-8973fed9a339 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:58.096054 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-56746754-e733-4c90-a77a-8973fed9a339 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:58.273428 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-56746754-e733-4c90-a77a-8973fed9a339 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:58.289306 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-56746754-e733-4c90-a77a-8973fed9a339 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.207950 Jul 11 14:14:58.290020 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 90/185] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:58 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:58.591414 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-adf447c3-9f80-40fa-80cd-6eff94dfe8b9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:58.592146 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-adf447c3-9f80-40fa-80cd-6eff94dfe8b9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:58.598895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adf447c3-9f80-40fa-80cd-6eff94dfe8b9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:58.599353 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adf447c3-9f80-40fa-80cd-6eff94dfe8b9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:58.600155 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adf447c3-9f80-40fa-80cd-6eff94dfe8b9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:58.600610 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adf447c3-9f80-40fa-80cd-6eff94dfe8b9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:58.738098 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-adf447c3-9f80-40fa-80cd-6eff94dfe8b9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:58.745843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-adf447c3-9f80-40fa-80cd-6eff94dfe8b9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1315 microversion: 2.1 time: 0.158524 Jul 11 14:14:58.746465 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 96/186] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:58 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:14:59.306561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8b22f3bc-fa26-4ef2-9f63-1570d60b1aa5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:59.307118 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8b22f3bc-fa26-4ef2-9f63-1570d60b1aa5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:59.313229 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b22f3bc-fa26-4ef2-9f63-1570d60b1aa5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:59.313637 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b22f3bc-fa26-4ef2-9f63-1570d60b1aa5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:59.314432 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b22f3bc-fa26-4ef2-9f63-1570d60b1aa5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:59.314940 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b22f3bc-fa26-4ef2-9f63-1570d60b1aa5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:59.445243 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8b22f3bc-fa26-4ef2-9f63-1570d60b1aa5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:59.452613 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8b22f3bc-fa26-4ef2-9f63-1570d60b1aa5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.149967 Jul 11 14:14:59.453175 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 91/187] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:59 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:59.763211 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-862a0e05-ee27-49a8-8a09-d6c276d86e76 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:59.763823 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-862a0e05-ee27-49a8-8a09-d6c276d86e76 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:59.766363 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=54 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:59.772251 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-862a0e05-ee27-49a8-8a09-d6c276d86e76 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:59.772696 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-862a0e05-ee27-49a8-8a09-d6c276d86e76 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:59.773460 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-862a0e05-ee27-49a8-8a09-d6c276d86e76 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:59.773888 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-862a0e05-ee27-49a8-8a09-d6c276d86e76 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:59.905389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-862a0e05-ee27-49a8-8a09-d6c276d86e76 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:59.913008 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-862a0e05-ee27-49a8-8a09-d6c276d86e76 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1315 microversion: 2.1 time: 0.153758 Jul 11 14:14:59.913589 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 97/188] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:59 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:00.459277 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-0a3e7f04-3f61-4402-8c99-087ef9034bd1 req-f7bcc664-66ae-4b55-bb5c-ad966bacb545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa1201b-404f-43ee-ab93-303f01d18897", "name": "network-vif-plugged", "status": "completed", "tag": "35760169-c7ed-48e3-99e9-367bbd2965e0"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:00.470056 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b3718e9e-5aa7-4daa-8d14-d9dcd1643ce3 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:00.470719 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b3718e9e-5aa7-4daa-8d14-d9dcd1643ce3 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:00.477351 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-0a3e7f04-3f61-4402-8c99-087ef9034bd1 req-f7bcc664-66ae-4b55-bb5c-ad966bacb545 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:00.477855 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-0a3e7f04-3f61-4402-8c99-087ef9034bd1 req-f7bcc664-66ae-4b55-bb5c-ad966bacb545 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:00.485021 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3718e9e-5aa7-4daa-8d14-d9dcd1643ce3 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:00.485475 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3718e9e-5aa7-4daa-8d14-d9dcd1643ce3 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:00.486285 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3718e9e-5aa7-4daa-8d14-d9dcd1643ce3 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:00.486725 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3718e9e-5aa7-4daa-8d14-d9dcd1643ce3 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:00.498642 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-0a3e7f04-3f61-4402-8c99-087ef9034bd1 req-f7bcc664-66ae-4b55-bb5c-ad966bacb545 service nova] Creating event network-vif-plugged:35760169-c7ed-48e3-99e9-367bbd2965e0 for instance baa1201b-404f-43ee-ab93-303f01d18897 on hv-cinder-81914 Jul 11 14:15:00.504086 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-0a3e7f04-3f61-4402-8c99-087ef9034bd1 req-f7bcc664-66ae-4b55-bb5c-ad966bacb545 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048563 Jul 11 14:15:00.504698 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 92/189] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:15:00.656864 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b3718e9e-5aa7-4daa-8d14-d9dcd1643ce3 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:00.666716 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b3718e9e-5aa7-4daa-8d14-d9dcd1643ce3 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.200531 Jul 11 14:15:00.667307 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 98/190] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:00 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:15:00.930346 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5c65f715-b4ef-4ba4-b009-c9e7efa91da9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:00.931059 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5c65f715-b4ef-4ba4-b009-c9e7efa91da9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:00.937679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c65f715-b4ef-4ba4-b009-c9e7efa91da9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:00.938191 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c65f715-b4ef-4ba4-b009-c9e7efa91da9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:00.938957 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c65f715-b4ef-4ba4-b009-c9e7efa91da9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:00.939426 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c65f715-b4ef-4ba4-b009-c9e7efa91da9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:00.954669 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:01.078780 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5c65f715-b4ef-4ba4-b009-c9e7efa91da9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:01.087043 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5c65f715-b4ef-4ba4-b009-c9e7efa91da9 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1315 microversion: 2.1 time: 0.161831 Jul 11 14:15:01.087721 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 93/191] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:00 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:01.684283 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e41d5d61-ad8d-4fc1-a2d3-a25934f3c553 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:01.684900 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e41d5d61-ad8d-4fc1-a2d3-a25934f3c553 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:01.692274 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e41d5d61-ad8d-4fc1-a2d3-a25934f3c553 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:01.692719 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e41d5d61-ad8d-4fc1-a2d3-a25934f3c553 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:01.693489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e41d5d61-ad8d-4fc1-a2d3-a25934f3c553 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:01.693920 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e41d5d61-ad8d-4fc1-a2d3-a25934f3c553 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:01.827253 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e41d5d61-ad8d-4fc1-a2d3-a25934f3c553 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:01.835308 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e41d5d61-ad8d-4fc1-a2d3-a25934f3c553 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.154893 Jul 11 14:15:01.835908 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 99/192] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:01 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:15:02.115276 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-32798ab2-4680-4561-b567-1740d421068b tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:02.115907 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-32798ab2-4680-4561-b567-1740d421068b tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:02.124430 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-32798ab2-4680-4561-b567-1740d421068b tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:02.125057 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-32798ab2-4680-4561-b567-1740d421068b tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:02.125840 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-32798ab2-4680-4561-b567-1740d421068b tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:02.126304 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-32798ab2-4680-4561-b567-1740d421068b tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:02.268548 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-32798ab2-4680-4561-b567-1740d421068b tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:02.276007 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-32798ab2-4680-4561-b567-1740d421068b tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1315 microversion: 2.1 time: 0.175314 Jul 11 14:15:02.276569 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 94/193] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:02 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:02.853772 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-52a5bc14-502a-40b3-87e2-481153272b72 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:02.854446 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-52a5bc14-502a-40b3-87e2-481153272b72 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:02.861102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52a5bc14-502a-40b3-87e2-481153272b72 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:02.861544 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52a5bc14-502a-40b3-87e2-481153272b72 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:02.862368 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52a5bc14-502a-40b3-87e2-481153272b72 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:02.863013 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52a5bc14-502a-40b3-87e2-481153272b72 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:02.995024 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-52a5bc14-502a-40b3-87e2-481153272b72 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:03.003068 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-52a5bc14-502a-40b3-87e2-481153272b72 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.153594 Jul 11 14:15:03.003735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 100/194] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:02 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:03.293220 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5154d731-ca00-4879-ba9b-d70446409f88 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:03.293832 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5154d731-ca00-4879-ba9b-d70446409f88 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:03.299731 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5154d731-ca00-4879-ba9b-d70446409f88 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:03.300434 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5154d731-ca00-4879-ba9b-d70446409f88 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:03.301347 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5154d731-ca00-4879-ba9b-d70446409f88 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:03.301778 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5154d731-ca00-4879-ba9b-d70446409f88 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:03.446974 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5154d731-ca00-4879-ba9b-d70446409f88 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:03.455634 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5154d731-ca00-4879-ba9b-d70446409f88 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1465 microversion: 2.1 time: 0.166021 Jul 11 14:15:03.456921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 95/195] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:03 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1465 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:03.496372 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-da79c0ac-3b5c-4115-84bc-2a027a7f3ae3 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:03.496876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-da79c0ac-3b5c-4115-84bc-2a027a7f3ae3 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:03.503550 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da79c0ac-3b5c-4115-84bc-2a027a7f3ae3 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:03.503996 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da79c0ac-3b5c-4115-84bc-2a027a7f3ae3 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:03.504917 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da79c0ac-3b5c-4115-84bc-2a027a7f3ae3 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:03.505604 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da79c0ac-3b5c-4115-84bc-2a027a7f3ae3 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:03.531540 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-da79c0ac-3b5c-4115-84bc-2a027a7f3ae3 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:15:03.650344 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-da79c0ac-3b5c-4115-84bc-2a027a7f3ae3 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "DELETE /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 204 len: 0 microversion: 2.1 time: 0.157300 Jul 11 14:15:03.651681 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 101/196] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:15:03 2022] DELETE /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 11 14:15:03.660236 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c2b106f8-8a20-42bf-a3fd-c6c4109fb592 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:03.661081 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c2b106f8-8a20-42bf-a3fd-c6c4109fb592 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:03.668458 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2b106f8-8a20-42bf-a3fd-c6c4109fb592 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:03.675499 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2b106f8-8a20-42bf-a3fd-c6c4109fb592 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:03.676381 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2b106f8-8a20-42bf-a3fd-c6c4109fb592 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:03.676965 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2b106f8-8a20-42bf-a3fd-c6c4109fb592 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:03.852044 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c2b106f8-8a20-42bf-a3fd-c6c4109fb592 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:03.861515 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c2b106f8-8a20-42bf-a3fd-c6c4109fb592 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1471 microversion: 2.1 time: 0.205431 Jul 11 14:15:03.862119 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 96/197] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:03 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:04.022602 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2908ca67-dc5e-4f5f-b15a-6f8f0516ac62 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:04.023600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2908ca67-dc5e-4f5f-b15a-6f8f0516ac62 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:04.040875 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2908ca67-dc5e-4f5f-b15a-6f8f0516ac62 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:04.041344 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2908ca67-dc5e-4f5f-b15a-6f8f0516ac62 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:04.042371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2908ca67-dc5e-4f5f-b15a-6f8f0516ac62 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:04.042798 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2908ca67-dc5e-4f5f-b15a-6f8f0516ac62 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:04.193886 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2908ca67-dc5e-4f5f-b15a-6f8f0516ac62 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:04.202663 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2908ca67-dc5e-4f5f-b15a-6f8f0516ac62 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.185251 Jul 11 14:15:04.203387 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 102/198] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:04 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:04.880649 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c1931ed9-d688-455e-aed0-3dbcd04e65ba tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:04.881286 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c1931ed9-d688-455e-aed0-3dbcd04e65ba tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:04.888097 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c1931ed9-d688-455e-aed0-3dbcd04e65ba tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:04.888550 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c1931ed9-d688-455e-aed0-3dbcd04e65ba tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:04.890489 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c1931ed9-d688-455e-aed0-3dbcd04e65ba tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:04.890489 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c1931ed9-d688-455e-aed0-3dbcd04e65ba tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:05.034691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c1931ed9-d688-455e-aed0-3dbcd04e65ba tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:05.042910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c1931ed9-d688-455e-aed0-3dbcd04e65ba tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1471 microversion: 2.1 time: 0.166337 Jul 11 14:15:05.044036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 97/199] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:04 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:05.220940 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-152c9eb9-5f53-40d7-aae7-f5f1457c3a05 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:05.222181 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-152c9eb9-5f53-40d7-aae7-f5f1457c3a05 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:05.232187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-152c9eb9-5f53-40d7-aae7-f5f1457c3a05 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:05.232863 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-152c9eb9-5f53-40d7-aae7-f5f1457c3a05 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:05.234184 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-152c9eb9-5f53-40d7-aae7-f5f1457c3a05 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:05.234628 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-152c9eb9-5f53-40d7-aae7-f5f1457c3a05 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:05.394307 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-152c9eb9-5f53-40d7-aae7-f5f1457c3a05 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:05.402435 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-152c9eb9-5f53-40d7-aae7-f5f1457c3a05 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.185249 Jul 11 14:15:05.403263 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 103/200] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:05 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:06.060819 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f0e4f677-4c4c-4233-867c-8e508bdae30d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:06.061599 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f0e4f677-4c4c-4233-867c-8e508bdae30d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:06.068194 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0e4f677-4c4c-4233-867c-8e508bdae30d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:06.068727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0e4f677-4c4c-4233-867c-8e508bdae30d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:06.069421 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0e4f677-4c4c-4233-867c-8e508bdae30d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:06.069894 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0e4f677-4c4c-4233-867c-8e508bdae30d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:06.308533 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f0e4f677-4c4c-4233-867c-8e508bdae30d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:06.317470 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f0e4f677-4c4c-4233-867c-8e508bdae30d tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1471 microversion: 2.1 time: 0.260396 Jul 11 14:15:06.319234 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 98/201] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:06 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1471 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:06.420922 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-13648d16-c18d-4a0c-b027-c5efd765bbf6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:06.422736 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-13648d16-c18d-4a0c-b027-c5efd765bbf6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:06.449942 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13648d16-c18d-4a0c-b027-c5efd765bbf6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:06.450422 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13648d16-c18d-4a0c-b027-c5efd765bbf6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:06.451259 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13648d16-c18d-4a0c-b027-c5efd765bbf6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:06.451616 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13648d16-c18d-4a0c-b027-c5efd765bbf6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:06.458137 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:06.477614 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-9b22a3ed-4076-4bfb-b9a9-acaa34b8c5e4 req-374e95c1-9e36-4cf5-85e7-b7413caa9773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa1201b-404f-43ee-ab93-303f01d18897", "name": "network-vif-deleted", "tag": "35760169-c7ed-48e3-99e9-367bbd2965e0"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:06.492894 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-9b22a3ed-4076-4bfb-b9a9-acaa34b8c5e4 req-374e95c1-9e36-4cf5-85e7-b7413caa9773 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:06.496120 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-9b22a3ed-4076-4bfb-b9a9-acaa34b8c5e4 req-374e95c1-9e36-4cf5-85e7-b7413caa9773 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:06.511280 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-9b22a3ed-4076-4bfb-b9a9-acaa34b8c5e4 req-374e95c1-9e36-4cf5-85e7-b7413caa9773 service nova] Creating event network-vif-deleted:35760169-c7ed-48e3-99e9-367bbd2965e0 for instance baa1201b-404f-43ee-ab93-303f01d18897 on hv-cinder-81914 Jul 11 14:15:06.527139 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-9b22a3ed-4076-4bfb-b9a9-acaa34b8c5e4 req-374e95c1-9e36-4cf5-85e7-b7413caa9773 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055622 Jul 11 14:15:06.528549 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 99/202] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:15:06.733830 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-13648d16-c18d-4a0c-b027-c5efd765bbf6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:06.770632 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-13648d16-c18d-4a0c-b027-c5efd765bbf6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.353917 Jul 11 14:15:06.772510 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 104/203] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:06 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:07.337550 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-afcc1673-c649-4898-af3b-f969a918bed6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:07.339221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-afcc1673-c649-4898-af3b-f969a918bed6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:07.345997 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-afcc1673-c649-4898-af3b-f969a918bed6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:07.346634 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-afcc1673-c649-4898-af3b-f969a918bed6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:07.348055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-afcc1673-c649-4898-af3b-f969a918bed6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:07.348634 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-afcc1673-c649-4898-af3b-f969a918bed6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:07.391625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-afcc1673-c649-4898-af3b-f969a918bed6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:07.392282 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-afcc1673-c649-4898-af3b-f969a918bed6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:07.392907 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-afcc1673-c649-4898-af3b-f969a918bed6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lazy-loading 'fault' on Instance uuid baa1201b-404f-43ee-ab93-303f01d18897 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:15:07.454873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-afcc1673-c649-4898-af3b-f969a918bed6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7bd87bcd9b148d899ceb09f9f311ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc773c1e59304cf58c89bfd6707b7ec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:07.470062 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-afcc1673-c649-4898-af3b-f969a918bed6 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 200 len: 1305 microversion: 2.1 time: 0.138196 Jul 11 14:15:07.471253 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 100/204] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:07 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 1305 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:07.789821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-df4a6075-8203-471e-a1d8-4bdcc3773777 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:07.790963 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-df4a6075-8203-471e-a1d8-4bdcc3773777 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:07.800535 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df4a6075-8203-471e-a1d8-4bdcc3773777 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:07.801656 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df4a6075-8203-471e-a1d8-4bdcc3773777 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:07.803406 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df4a6075-8203-471e-a1d8-4bdcc3773777 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:07.804110 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df4a6075-8203-471e-a1d8-4bdcc3773777 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:07.957850 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-df4a6075-8203-471e-a1d8-4bdcc3773777 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:07.966276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-df4a6075-8203-471e-a1d8-4bdcc3773777 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.181328 Jul 11 14:15:07.967098 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 105/205] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:07 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:08.487640 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-99aafe85-f7b9-4caa-9ae5-3d65be003647 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:08.488261 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-99aafe85-f7b9-4caa-9ae5-3d65be003647 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] [instance: baa1201b-404f-43ee-ab93-303f01d18897] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:08.495196 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99aafe85-f7b9-4caa-9ae5-3d65be003647 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:08.495675 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99aafe85-f7b9-4caa-9ae5-3d65be003647 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:08.496446 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99aafe85-f7b9-4caa-9ae5-3d65be003647 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:08.496909 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99aafe85-f7b9-4caa-9ae5-3d65be003647 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:08.513119 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-99aafe85-f7b9-4caa-9ae5-3d65be003647 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] HTTP exception thrown: Instance baa1201b-404f-43ee-ab93-303f01d18897 could not be found. Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-99aafe85-f7b9-4caa-9ae5-3d65be003647 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Request method failure captured: Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 HTTP/1.1 Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDBNB1ET1fW3dre8fB9gRPfebQrC66fkGLu-UL-OBJnepBpvWbe-e4wLPxLDwCBI7jbVBX-3isPN-E8OBvCm6V4FKX2kuq3fSvsgHoNLeHqOC2ly5WOI4nUmBUpDnTFJKWiKbF_6ZC4pA7A4M5A2cnGvfzQpo-BM1vmdy6XySf1_l6s Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: bc773c1e59304cf58c89bfd6707b7ec0 Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesNegativeTest-511986563 Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:15:08.514787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:15:08.516268 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bc773c1e59304cf58c89bfd6707b7ec0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bc773c1e59304cf58c89bfd6707b7ec0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bc773c1e59304cf58c89bfd6707b7ec0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bc773c1e59304cf58c89bfd6707b7ec0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:15:08.516268 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesNegativeTest-511986563 Jul 11 14:15:08.516268 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: bc773c1e59304cf58c89bfd6707b7ec0 Jul 11 14:15:08.516268 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesNegativeTest-511986563 Jul 11 14:15:08.516268 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesNegativeTest-511986563-project Jul 11 14:15:08.516268 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:15:08.516268 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:15:08.516268 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: e7bd87bcd9b148d899ceb09f9f311ad0 Jul 11 14:15:08.516268 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesNegativeTest-511986563-project Jul 11 14:15:08.516268 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:15:08.516268 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance baa1201b-404f-43ee-ab93-303f01d18897 could not be found. Jul 11 14:15:08.516268 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': 'baa1201b-404f-43ee-ab93-303f01d18897'} Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baa1201b-404f-43ee-ab93-303f01d18897 could not be found. Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:15:08.517159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:15:08.519241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:15:08.519241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:15:08.519241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:15:08.519241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:15:08.519241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:15:08.519241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:15:08.519241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:15:08.519241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baa1201b-404f-43ee-ab93-303f01d18897 could not be found. Jul 11 14:15:08.519241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:15:08.519241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:15:08.519241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:15:08.519241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:15:08.519241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:15:08.519241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:15:08.519241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:15:08.519241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:15:08.519241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baa1201b-404f-43ee-ab93-303f01d18897 could not be found. Jul 11 14:15:08.519241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:15:08.520473 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-99aafe85-f7b9-4caa-9ae5-3d65be003647 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] Returning 404 to user: Instance baa1201b-404f-43ee-ab93-303f01d18897 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:15:08.520473 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-99aafe85-f7b9-4caa-9ae5-3d65be003647 tempest-VolumesNegativeTest-511986563 tempest-VolumesNegativeTest-511986563-project] 10.222.0.66 "GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897" status: 404 len: 111 microversion: 2.1 time: 0.032508 Jul 11 14:15:08.520473 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 101/206] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:08 2022] GET /compute/v2.1/servers/baa1201b-404f-43ee-ab93-303f01d18897 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:15:08.983973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7fe5c41a-a959-4f9a-a5a6-f46bda5b4ce7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:08.984579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7fe5c41a-a959-4f9a-a5a6-f46bda5b4ce7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:08.992203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fe5c41a-a959-4f9a-a5a6-f46bda5b4ce7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:08.992843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fe5c41a-a959-4f9a-a5a6-f46bda5b4ce7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:08.994055 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fe5c41a-a959-4f9a-a5a6-f46bda5b4ce7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:08.994995 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fe5c41a-a959-4f9a-a5a6-f46bda5b4ce7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:09.207671 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7fe5c41a-a959-4f9a-a5a6-f46bda5b4ce7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:09.219855 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7fe5c41a-a959-4f9a-a5a6-f46bda5b4ce7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1521 microversion: 2.1 time: 0.239691 Jul 11 14:15:09.223909 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 106/207] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:08 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:10.238718 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2e24a65d-5c20-496f-8e5c-12486a08f21f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:10.239337 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2e24a65d-5c20-496f-8e5c-12486a08f21f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:10.246053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e24a65d-5c20-496f-8e5c-12486a08f21f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:10.246531 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e24a65d-5c20-496f-8e5c-12486a08f21f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:10.247304 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e24a65d-5c20-496f-8e5c-12486a08f21f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:10.254582 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e24a65d-5c20-496f-8e5c-12486a08f21f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:10.511975 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2e24a65d-5c20-496f-8e5c-12486a08f21f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:10.521446 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2e24a65d-5c20-496f-8e5c-12486a08f21f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1501 microversion: 2.1 time: 0.287284 Jul 11 14:15:10.524650 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 102/208] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:10 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1501 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:10.541223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4e8822a9-17ec-4a37-b064-21bcfb44d49b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:10.541846 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4e8822a9-17ec-4a37-b064-21bcfb44d49b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:10.550615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e8822a9-17ec-4a37-b064-21bcfb44d49b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:10.555543 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e8822a9-17ec-4a37-b064-21bcfb44d49b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:10.556371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e8822a9-17ec-4a37-b064-21bcfb44d49b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:10.556814 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e8822a9-17ec-4a37-b064-21bcfb44d49b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:10.845620 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4e8822a9-17ec-4a37-b064-21bcfb44d49b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:10.858325 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4e8822a9-17ec-4a37-b064-21bcfb44d49b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1516 microversion: 2.1 time: 0.320914 Jul 11 14:15:10.859609 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 107/209] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:10 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1516 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:17.844909 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ee86e379-eefe-4ecc-87ca-2501f2462e57 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:17.845771 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ee86e379-eefe-4ecc-87ca-2501f2462e57 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:17.848960 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=48 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:17.856999 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee86e379-eefe-4ecc-87ca-2501f2462e57 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:17.857439 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee86e379-eefe-4ecc-87ca-2501f2462e57 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:17.858282 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee86e379-eefe-4ecc-87ca-2501f2462e57 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:17.858707 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee86e379-eefe-4ecc-87ca-2501f2462e57 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:17.882574 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-ee86e379-eefe-4ecc-87ca-2501f2462e57 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lazy-loading 'flavor' on Instance uuid ce9c0371-22ec-432a-9835-696bc61b05de {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:15:17.958829 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ee86e379-eefe-4ecc-87ca-2501f2462e57 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "POST /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de/action" status: 200 len: 32 microversion: 2.1 time: 0.117709 Jul 11 14:15:17.959445 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 103/210] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 11 14:15:17 2022] POST /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de/action => generated 32 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 14:15:17.968688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-21268773-0981-424e-bc2b-9c6b61fb8323 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:17.969391 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-21268773-0981-424e-bc2b-9c6b61fb8323 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:17.977686 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21268773-0981-424e-bc2b-9c6b61fb8323 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:17.978437 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21268773-0981-424e-bc2b-9c6b61fb8323 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:17.979812 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21268773-0981-424e-bc2b-9c6b61fb8323 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:17.980498 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21268773-0981-424e-bc2b-9c6b61fb8323 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:18.120108 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-21268773-0981-424e-bc2b-9c6b61fb8323 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:18.127880 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-21268773-0981-424e-bc2b-9c6b61fb8323 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.162944 Jul 11 14:15:18.128578 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 108/211] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:17 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:19.147883 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-de907735-74e7-475f-a6c6-de0e64c521fe tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:19.148595 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-de907735-74e7-475f-a6c6-de0e64c521fe tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:19.163130 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-de907735-74e7-475f-a6c6-de0e64c521fe tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:19.164298 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-de907735-74e7-475f-a6c6-de0e64c521fe tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:19.167152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-de907735-74e7-475f-a6c6-de0e64c521fe tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:19.167958 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-de907735-74e7-475f-a6c6-de0e64c521fe tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:19.393690 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-de907735-74e7-475f-a6c6-de0e64c521fe tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:19.403087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-de907735-74e7-475f-a6c6-de0e64c521fe tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.261830 Jul 11 14:15:19.405096 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 104/212] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:19 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:19.649422 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ff5cf883-8806-4a8d-9989-a64cfc73deb1 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:19.649982 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ff5cf883-8806-4a8d-9989-a64cfc73deb1 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:19.657264 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff5cf883-8806-4a8d-9989-a64cfc73deb1 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:19.658005 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff5cf883-8806-4a8d-9989-a64cfc73deb1 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:19.659465 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff5cf883-8806-4a8d-9989-a64cfc73deb1 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:19.660616 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff5cf883-8806-4a8d-9989-a64cfc73deb1 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:19.693809 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ff5cf883-8806-4a8d-9989-a64cfc73deb1 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27/ips" status: 200 len: 147 microversion: 2.1 time: 0.048280 Jul 11 14:15:19.694488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 109/213] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 11 14:15:19 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27/ips => generated 147 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:15:20.426582 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fc6c6b17-5643-4f10-b2f9-ae5107539fba tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:20.427639 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fc6c6b17-5643-4f10-b2f9-ae5107539fba tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:20.442067 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc6c6b17-5643-4f10-b2f9-ae5107539fba tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:20.443238 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc6c6b17-5643-4f10-b2f9-ae5107539fba tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:20.444506 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc6c6b17-5643-4f10-b2f9-ae5107539fba tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:20.445560 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc6c6b17-5643-4f10-b2f9-ae5107539fba tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:20.671494 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fc6c6b17-5643-4f10-b2f9-ae5107539fba tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:20.685881 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fc6c6b17-5643-4f10-b2f9-ae5107539fba tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.267318 Jul 11 14:15:20.687076 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 105/214] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:20 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:21.704384 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f206d403-2a7d-4524-bb90-d854f5d543b7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:21.705907 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f206d403-2a7d-4524-bb90-d854f5d543b7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:21.712732 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f206d403-2a7d-4524-bb90-d854f5d543b7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:21.713269 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f206d403-2a7d-4524-bb90-d854f5d543b7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:21.714112 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f206d403-2a7d-4524-bb90-d854f5d543b7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:21.718151 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f206d403-2a7d-4524-bb90-d854f5d543b7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:21.872362 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f206d403-2a7d-4524-bb90-d854f5d543b7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:21.880796 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f206d403-2a7d-4524-bb90-d854f5d543b7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.181708 Jul 11 14:15:21.890671 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 110/215] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:21 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:22.680734 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b41f48d1-5147-46ce-9472-d26f2ae104e5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18a22eee-33a3-4316-8c14-08aa0af68f06"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:22.682486 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b41f48d1-5147-46ce-9472-d26f2ae104e5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:22.694370 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b41f48d1-5147-46ce-9472-d26f2ae104e5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:22.694824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b41f48d1-5147-46ce-9472-d26f2ae104e5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:22.696015 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b41f48d1-5147-46ce-9472-d26f2ae104e5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:22.696520 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b41f48d1-5147-46ce-9472-d26f2ae104e5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:22.899698 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a8a783dc-175f-4960-abab-ff11f6c2b38c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:22.900345 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a8a783dc-175f-4960-abab-ff11f6c2b38c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:22.911080 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a8a783dc-175f-4960-abab-ff11f6c2b38c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:22.912293 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a8a783dc-175f-4960-abab-ff11f6c2b38c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:22.913212 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a8a783dc-175f-4960-abab-ff11f6c2b38c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:22.913766 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a8a783dc-175f-4960-abab-ff11f6c2b38c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:23.136934 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a8a783dc-175f-4960-abab-ff11f6c2b38c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:23.148496 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a8a783dc-175f-4960-abab-ff11f6c2b38c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.253892 Jul 11 14:15:23.149281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 111/216] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:22 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:24.166562 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a1121d35-44c6-432a-a49d-dc64a34120ce tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:24.167880 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a1121d35-44c6-432a-a49d-dc64a34120ce tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:24.176120 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a1121d35-44c6-432a-a49d-dc64a34120ce tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:24.176959 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a1121d35-44c6-432a-a49d-dc64a34120ce tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:24.177990 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a1121d35-44c6-432a-a49d-dc64a34120ce tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:24.178769 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a1121d35-44c6-432a-a49d-dc64a34120ce tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:24.457481 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a1121d35-44c6-432a-a49d-dc64a34120ce tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:24.469212 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a1121d35-44c6-432a-a49d-dc64a34120ce tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.306633 Jul 11 14:15:24.470218 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 112/217] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:24 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:25.491519 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c8dd477f-803f-4d51-9438-5ffa92613db8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:25.493434 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c8dd477f-803f-4d51-9438-5ffa92613db8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:25.505398 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8dd477f-803f-4d51-9438-5ffa92613db8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:25.519703 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b41f48d1-5147-46ce-9472-d26f2ae104e5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "POST /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.845819 Jul 11 14:15:25.520871 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 106/218] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 11 14:15:22 2022] POST /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27/os-volume_attachments => generated 194 bytes in 2848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:15:25.527137 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8dd477f-803f-4d51-9438-5ffa92613db8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:25.528147 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8dd477f-803f-4d51-9438-5ffa92613db8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:25.528602 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8dd477f-803f-4d51-9438-5ffa92613db8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:25.854511 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c8dd477f-803f-4d51-9438-5ffa92613db8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:25.865880 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c8dd477f-803f-4d51-9438-5ffa92613db8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.382567 Jul 11 14:15:25.875631 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 113/219] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:25 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:15:26.885124 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4c69eb3c-28c3-470e-ad87-3cef0d1072f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:26.885824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4c69eb3c-28c3-470e-ad87-3cef0d1072f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:26.902599 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c69eb3c-28c3-470e-ad87-3cef0d1072f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:26.903386 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c69eb3c-28c3-470e-ad87-3cef0d1072f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:26.904566 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c69eb3c-28c3-470e-ad87-3cef0d1072f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:26.905245 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c69eb3c-28c3-470e-ad87-3cef0d1072f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:27.187769 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4c69eb3c-28c3-470e-ad87-3cef0d1072f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:27.190925 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:27.201638 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4c69eb3c-28c3-470e-ad87-3cef0d1072f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.321506 Jul 11 14:15:27.202819 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 107/220] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:26 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:28.220144 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-43b8dc80-c748-4bf8-8267-478a047a6c59 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:28.221299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-43b8dc80-c748-4bf8-8267-478a047a6c59 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:28.232163 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43b8dc80-c748-4bf8-8267-478a047a6c59 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:28.232606 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43b8dc80-c748-4bf8-8267-478a047a6c59 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:28.233379 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43b8dc80-c748-4bf8-8267-478a047a6c59 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:28.233801 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43b8dc80-c748-4bf8-8267-478a047a6c59 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:28.397244 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-43b8dc80-c748-4bf8-8267-478a047a6c59 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:28.407891 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-43b8dc80-c748-4bf8-8267-478a047a6c59 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.192079 Jul 11 14:15:28.408839 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 114/221] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:28 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:29.431083 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-dec8b5fb-01ad-478e-8f2a-d25c6968e7e7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:29.432925 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-dec8b5fb-01ad-478e-8f2a-d25c6968e7e7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:29.449502 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dec8b5fb-01ad-478e-8f2a-d25c6968e7e7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:29.450301 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dec8b5fb-01ad-478e-8f2a-d25c6968e7e7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:29.451573 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dec8b5fb-01ad-478e-8f2a-d25c6968e7e7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:29.452454 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dec8b5fb-01ad-478e-8f2a-d25c6968e7e7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:29.793284 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ad42ebd8-8451-445c-b261-875ae0d3b42a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1475276789", "imageRef": "67874ac7-fac8-4d6d-9cd1-9091ecb957b6", "flavorRef": "452", "networks": [{"uuid": "6ff114ce-bbaa-4b1f-83c3-fc24459f1bd0"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:29.813631 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:29.891116 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-ad42ebd8-8451-445c-b261-875ae0d3b42a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] validate_networks() for [('6ff114ce-bbaa-4b1f-83c3-fc24459f1bd0', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:15:29.981443 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-dec8b5fb-01ad-478e-8f2a-d25c6968e7e7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:29.989698 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-dec8b5fb-01ad-478e-8f2a-d25c6968e7e7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.562745 Jul 11 14:15:29.990320 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 108/222] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:29 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:30.490787 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ad42ebd8-8451-445c-b261-875ae0d3b42a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:15:30.491260 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ad42ebd8-8451-445c-b261-875ae0d3b42a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:15:30.491736 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ad42ebd8-8451-445c-b261-875ae0d3b42a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:15:30.492138 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ad42ebd8-8451-445c-b261-875ae0d3b42a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:15:30.492630 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ad42ebd8-8451-445c-b261-875ae0d3b42a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:15:30.508109 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad42ebd8-8451-445c-b261-875ae0d3b42a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:30.508828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad42ebd8-8451-445c-b261-875ae0d3b42a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:30.511254 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad42ebd8-8451-445c-b261-875ae0d3b42a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:30.511963 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad42ebd8-8451-445c-b261-875ae0d3b42a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:30.533674 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-ad42ebd8-8451-445c-b261-875ae0d3b42a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Getting quotas for project bdc81783ff1f4a47b617e77618303f94. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:15:30.538559 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-ad42ebd8-8451-445c-b261-875ae0d3b42a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Getting quotas for user bf2b65c48bc141abbd3c56b791b213ae and project bdc81783ff1f4a47b617e77618303f94. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:15:30.551504 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ad42ebd8-8451-445c-b261-875ae0d3b42a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:15:30.554362 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ad42ebd8-8451-445c-b261-875ae0d3b42a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67874ac7-fac8-4d6d-9cd1-9091ecb957b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:15:30.615530 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ad42ebd8-8451-445c-b261-875ae0d3b42a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826649 Jul 11 14:15:30.616392 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 115/223] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:15:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:15:30.626714 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b7256dc4-a764-4e65-960a-795c840f547d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:30.627380 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b7256dc4-a764-4e65-960a-795c840f547d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:30.748906 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b7256dc4-a764-4e65-960a-795c840f547d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:30.758615 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b7256dc4-a764-4e65-960a-795c840f547d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1214 microversion: 2.1 time: 0.136039 Jul 11 14:15:30.772235 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 109/224] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:30 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:31.009300 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cf3cf7b4-09c7-416f-94ba-3a032cb07446 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:31.010745 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cf3cf7b4-09c7-416f-94ba-3a032cb07446 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:31.033819 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf3cf7b4-09c7-416f-94ba-3a032cb07446 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:31.035322 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf3cf7b4-09c7-416f-94ba-3a032cb07446 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:31.037753 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf3cf7b4-09c7-416f-94ba-3a032cb07446 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:31.038660 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf3cf7b4-09c7-416f-94ba-3a032cb07446 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:31.393611 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cf3cf7b4-09c7-416f-94ba-3a032cb07446 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:31.405318 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cf3cf7b4-09c7-416f-94ba-3a032cb07446 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.401208 Jul 11 14:15:31.406396 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 116/225] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:31 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:31.780747 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ddcac8b3-dbf9-4999-949d-40500ca2520a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:31.781700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ddcac8b3-dbf9-4999-949d-40500ca2520a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:31.790908 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ddcac8b3-dbf9-4999-949d-40500ca2520a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:31.796820 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ddcac8b3-dbf9-4999-949d-40500ca2520a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:31.797909 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ddcac8b3-dbf9-4999-949d-40500ca2520a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:31.800754 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ddcac8b3-dbf9-4999-949d-40500ca2520a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:31.959762 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ddcac8b3-dbf9-4999-949d-40500ca2520a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:31.976396 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ddcac8b3-dbf9-4999-949d-40500ca2520a tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1218 microversion: 2.1 time: 0.199869 Jul 11 14:15:31.977013 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 110/226] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:31 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1218 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:32.423138 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9e1e5348-b83c-4e3c-bcc3-d4d9daa68676 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:32.424624 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9e1e5348-b83c-4e3c-bcc3-d4d9daa68676 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:32.441073 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e1e5348-b83c-4e3c-bcc3-d4d9daa68676 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:32.442028 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e1e5348-b83c-4e3c-bcc3-d4d9daa68676 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:32.443190 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e1e5348-b83c-4e3c-bcc3-d4d9daa68676 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:32.443862 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e1e5348-b83c-4e3c-bcc3-d4d9daa68676 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:32.724713 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9e1e5348-b83c-4e3c-bcc3-d4d9daa68676 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:32.752894 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9e1e5348-b83c-4e3c-bcc3-d4d9daa68676 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.333896 Jul 11 14:15:32.758229 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 117/227] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:32 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:32.992841 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-63696617-8861-4ed9-a83c-1a19ab1730ba tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:32.993450 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-63696617-8861-4ed9-a83c-1a19ab1730ba tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:33.002035 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63696617-8861-4ed9-a83c-1a19ab1730ba tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:33.002762 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63696617-8861-4ed9-a83c-1a19ab1730ba tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:33.003706 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63696617-8861-4ed9-a83c-1a19ab1730ba tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:33.004294 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63696617-8861-4ed9-a83c-1a19ab1730ba tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:33.103964 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-63696617-8861-4ed9-a83c-1a19ab1730ba tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:33.112346 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-63696617-8861-4ed9-a83c-1a19ab1730ba tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1266 microversion: 2.1 time: 0.123274 Jul 11 14:15:33.119286 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 111/228] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:32 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:33.787263 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-01d2825e-b2ab-4500-9cb8-585094ffd7d5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:33.787965 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-01d2825e-b2ab-4500-9cb8-585094ffd7d5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:33.802573 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01d2825e-b2ab-4500-9cb8-585094ffd7d5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:33.804719 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01d2825e-b2ab-4500-9cb8-585094ffd7d5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:33.806051 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01d2825e-b2ab-4500-9cb8-585094ffd7d5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:33.806933 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01d2825e-b2ab-4500-9cb8-585094ffd7d5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:34.130447 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1b38a356-2d0d-4b4e-b4a4-6bedcd308a1e tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:34.131949 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1b38a356-2d0d-4b4e-b4a4-6bedcd308a1e tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:34.144906 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1b38a356-2d0d-4b4e-b4a4-6bedcd308a1e tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:34.146520 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1b38a356-2d0d-4b4e-b4a4-6bedcd308a1e tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:34.147333 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1b38a356-2d0d-4b4e-b4a4-6bedcd308a1e tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:34.147772 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1b38a356-2d0d-4b4e-b4a4-6bedcd308a1e tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:34.249969 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-01d2825e-b2ab-4500-9cb8-585094ffd7d5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:34.269407 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-01d2825e-b2ab-4500-9cb8-585094ffd7d5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.496317 Jul 11 14:15:34.277860 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 118/229] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:33 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:34.296055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1b38a356-2d0d-4b4e-b4a4-6bedcd308a1e tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:34.315174 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1b38a356-2d0d-4b4e-b4a4-6bedcd308a1e tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1272 microversion: 2.1 time: 0.189843 Jul 11 14:15:34.316776 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 112/230] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:34 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1272 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:34.992653 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0701b54a-e831-4ce0-ae6b-29ab8c6d52f6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Action: 'create', calling method: .version_select at 0x7fc97c056820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1954347746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR6XEO4Qs+wqEslt2LuYzucfY9wKsyS/eAsxKKvXGGNpYfHkrX0nO8OfxZ4/s4YF4wzEat4/FvuBeKr0881efWnoVjoVQaRDByvR/9lAfbQiAESa4ULJjy+3PekUVh90A=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:35.014372 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-0701b54a-e831-4ce0-ae6b-29ab8c6d52f6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Getting quotas for project 5c6666e112684b9ea973be1c5833b0cb. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:15:35.018980 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-0701b54a-e831-4ce0-ae6b-29ab8c6d52f6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Getting quotas for user 8455bd8a1dd841c6bac62b553f06e683 and project 5c6666e112684b9ea973be1c5833b0cb. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:15:35.062550 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0701b54a-e831-4ce0-ae6b-29ab8c6d52f6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.299150 Jul 11 14:15:35.063171 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 119/231] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 11 14:15:34 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:15:35.296735 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f12ba40c-bc0f-46d7-bd5c-923d9e2a9acb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:35.297965 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f12ba40c-bc0f-46d7-bd5c-923d9e2a9acb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:35.305813 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f12ba40c-bc0f-46d7-bd5c-923d9e2a9acb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:35.306187 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f12ba40c-bc0f-46d7-bd5c-923d9e2a9acb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:35.307027 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f12ba40c-bc0f-46d7-bd5c-923d9e2a9acb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:35.307796 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f12ba40c-bc0f-46d7-bd5c-923d9e2a9acb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:35.339376 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-108a2dd8-a2a6-40d4-96eb-5b822b1325e8 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:35.341159 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-108a2dd8-a2a6-40d4-96eb-5b822b1325e8 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:35.356452 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-108a2dd8-a2a6-40d4-96eb-5b822b1325e8 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:35.357585 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-108a2dd8-a2a6-40d4-96eb-5b822b1325e8 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:35.358636 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-108a2dd8-a2a6-40d4-96eb-5b822b1325e8 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:35.359217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-108a2dd8-a2a6-40d4-96eb-5b822b1325e8 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:35.520217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-108a2dd8-a2a6-40d4-96eb-5b822b1325e8 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:35.528897 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-108a2dd8-a2a6-40d4-96eb-5b822b1325e8 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1314 microversion: 2.1 time: 0.200387 Jul 11 14:15:35.529579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 120/232] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:35 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:35.583730 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f12ba40c-bc0f-46d7-bd5c-923d9e2a9acb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:35.597471 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f12ba40c-bc0f-46d7-bd5c-923d9e2a9acb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.304343 Jul 11 14:15:35.619433 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 113/233] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:35 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:36.545407 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-261383c7-6885-49ad-9f82-34e47df48b01 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:36.546030 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-261383c7-6885-49ad-9f82-34e47df48b01 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:36.553271 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-261383c7-6885-49ad-9f82-34e47df48b01 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:36.553728 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-261383c7-6885-49ad-9f82-34e47df48b01 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:36.554529 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-261383c7-6885-49ad-9f82-34e47df48b01 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:36.554972 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-261383c7-6885-49ad-9f82-34e47df48b01 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:36.559263 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=89 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:36.618502 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b218cc5e-8bd0-413d-81fc-86d2b25e8ed7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:36.619960 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b218cc5e-8bd0-413d-81fc-86d2b25e8ed7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:36.628769 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b218cc5e-8bd0-413d-81fc-86d2b25e8ed7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:36.629222 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b218cc5e-8bd0-413d-81fc-86d2b25e8ed7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:36.630774 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b218cc5e-8bd0-413d-81fc-86d2b25e8ed7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:36.631376 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b218cc5e-8bd0-413d-81fc-86d2b25e8ed7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:36.727933 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-261383c7-6885-49ad-9f82-34e47df48b01 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:36.739592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-261383c7-6885-49ad-9f82-34e47df48b01 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1314 microversion: 2.1 time: 0.196457 Jul 11 14:15:36.742489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 121/234] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:36 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:36.794354 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b218cc5e-8bd0-413d-81fc-86d2b25e8ed7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:36.803801 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b218cc5e-8bd0-413d-81fc-86d2b25e8ed7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.190230 Jul 11 14:15:36.804389 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 114/235] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:36 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:37.763367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e5adaeb9-9c01-4d8a-b38c-e47ad535a611 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:37.764929 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-8d170943-834f-45f3-af71-e8691368fe3b req-2acbb29b-4486-4eab-bc31-4cf833eaca80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2218505-9930-439d-9bb5-c8061c5cfb63", "tag": "d60a00df-b670-47d2-b620-c664c77d9bbe"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:37.765930 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e5adaeb9-9c01-4d8a-b38c-e47ad535a611 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:37.781181 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5adaeb9-9c01-4d8a-b38c-e47ad535a611 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:37.781631 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5adaeb9-9c01-4d8a-b38c-e47ad535a611 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:37.782509 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5adaeb9-9c01-4d8a-b38c-e47ad535a611 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:37.782945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5adaeb9-9c01-4d8a-b38c-e47ad535a611 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:37.791381 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8d170943-834f-45f3-af71-e8691368fe3b req-2acbb29b-4486-4eab-bc31-4cf833eaca80 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:37.792363 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8d170943-834f-45f3-af71-e8691368fe3b req-2acbb29b-4486-4eab-bc31-4cf833eaca80 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:37.810494 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-8d170943-834f-45f3-af71-e8691368fe3b req-2acbb29b-4486-4eab-bc31-4cf833eaca80 service nova] Creating event network-changed:d60a00df-b670-47d2-b620-c664c77d9bbe for instance e2218505-9930-439d-9bb5-c8061c5cfb63 on hv-cinder-81914 Jul 11 14:15:37.818057 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-8d170943-834f-45f3-af71-e8691368fe3b req-2acbb29b-4486-4eab-bc31-4cf833eaca80 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062929 Jul 11 14:15:37.818862 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 122/236] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:15:37.828746 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-171453c8-9a18-487e-b5a8-fc49da1f2dc1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:37.832949 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-171453c8-9a18-487e-b5a8-fc49da1f2dc1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:37.849123 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-171453c8-9a18-487e-b5a8-fc49da1f2dc1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:37.850137 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-171453c8-9a18-487e-b5a8-fc49da1f2dc1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:37.851151 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-171453c8-9a18-487e-b5a8-fc49da1f2dc1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:37.852018 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-171453c8-9a18-487e-b5a8-fc49da1f2dc1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:38.007805 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e5adaeb9-9c01-4d8a-b38c-e47ad535a611 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:38.015508 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e5adaeb9-9c01-4d8a-b38c-e47ad535a611 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1314 microversion: 2.1 time: 0.256948 Jul 11 14:15:38.016607 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 115/237] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:37 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:15:38.103968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-171453c8-9a18-487e-b5a8-fc49da1f2dc1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:38.137256 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-171453c8-9a18-487e-b5a8-fc49da1f2dc1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.316756 Jul 11 14:15:38.137930 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 123/238] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:37 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:39.033885 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-267d1b58-4797-4e1f-8591-b194c0986f70 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:39.035580 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-267d1b58-4797-4e1f-8591-b194c0986f70 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:39.042015 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-267d1b58-4797-4e1f-8591-b194c0986f70 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:39.042679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-267d1b58-4797-4e1f-8591-b194c0986f70 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:39.043905 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-267d1b58-4797-4e1f-8591-b194c0986f70 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:39.044607 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-267d1b58-4797-4e1f-8591-b194c0986f70 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:39.155396 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5847a31a-2566-41a8-a40c-59e194e46da6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:39.156851 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5847a31a-2566-41a8-a40c-59e194e46da6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:39.175203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5847a31a-2566-41a8-a40c-59e194e46da6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:39.175848 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5847a31a-2566-41a8-a40c-59e194e46da6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:39.176747 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5847a31a-2566-41a8-a40c-59e194e46da6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:39.177440 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5847a31a-2566-41a8-a40c-59e194e46da6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:39.260007 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-267d1b58-4797-4e1f-8591-b194c0986f70 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:39.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-267d1b58-4797-4e1f-8591-b194c0986f70 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1314 microversion: 2.1 time: 0.244247 Jul 11 14:15:39.280041 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 116/239] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:39 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:39.393670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5847a31a-2566-41a8-a40c-59e194e46da6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:39.401741 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5847a31a-2566-41a8-a40c-59e194e46da6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.250675 Jul 11 14:15:39.402530 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 124/240] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:39 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:40.292622 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-100d9415-86c3-4c34-ae3d-38c3eeb76327 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:40.293269 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-100d9415-86c3-4c34-ae3d-38c3eeb76327 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:40.300678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-100d9415-86c3-4c34-ae3d-38c3eeb76327 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:40.301126 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-100d9415-86c3-4c34-ae3d-38c3eeb76327 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:40.301895 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-100d9415-86c3-4c34-ae3d-38c3eeb76327 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:40.307201 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-100d9415-86c3-4c34-ae3d-38c3eeb76327 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:40.419537 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ecee4037-a3c0-443c-9ee6-9351e32bec00 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:40.421065 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ecee4037-a3c0-443c-9ee6-9351e32bec00 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:40.429596 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecee4037-a3c0-443c-9ee6-9351e32bec00 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:40.430207 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecee4037-a3c0-443c-9ee6-9351e32bec00 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:40.431211 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecee4037-a3c0-443c-9ee6-9351e32bec00 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:40.431987 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecee4037-a3c0-443c-9ee6-9351e32bec00 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:40.445945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-100d9415-86c3-4c34-ae3d-38c3eeb76327 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:40.453425 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-100d9415-86c3-4c34-ae3d-38c3eeb76327 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1314 microversion: 2.1 time: 0.164617 Jul 11 14:15:40.454826 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 117/241] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:40 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:40.524020 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:40.807456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ecee4037-a3c0-443c-9ee6-9351e32bec00 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:40.816939 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ecee4037-a3c0-443c-9ee6-9351e32bec00 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.402359 Jul 11 14:15:40.817661 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 125/242] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:40 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:15:41.472875 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-be7a5e95-407f-4460-bdbc-6222a5996452 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:41.473548 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-be7a5e95-407f-4460-bdbc-6222a5996452 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:41.480836 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:41.483266 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be7a5e95-407f-4460-bdbc-6222a5996452 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:41.484080 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be7a5e95-407f-4460-bdbc-6222a5996452 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:41.485036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be7a5e95-407f-4460-bdbc-6222a5996452 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:41.486222 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be7a5e95-407f-4460-bdbc-6222a5996452 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:41.649966 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-be7a5e95-407f-4460-bdbc-6222a5996452 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:41.659882 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-be7a5e95-407f-4460-bdbc-6222a5996452 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1314 microversion: 2.1 time: 0.192376 Jul 11 14:15:41.660959 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 118/243] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:41 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:41.835950 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e08cb430-8e36-4e38-8aef-553db5f904c1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:41.836650 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e08cb430-8e36-4e38-8aef-553db5f904c1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:41.843393 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e08cb430-8e36-4e38-8aef-553db5f904c1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:41.843796 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e08cb430-8e36-4e38-8aef-553db5f904c1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:41.845562 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e08cb430-8e36-4e38-8aef-553db5f904c1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:41.846032 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e08cb430-8e36-4e38-8aef-553db5f904c1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:41.958099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-87e10f01-4858-4232-a5ba-6e1c374d2dba tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:41.965372 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-87e10f01-4858-4232-a5ba-6e1c374d2dba tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:41.966219 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-87e10f01-4858-4232-a5ba-6e1c374d2dba tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:41.995612 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e08cb430-8e36-4e38-8aef-553db5f904c1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:42.007116 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e08cb430-8e36-4e38-8aef-553db5f904c1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1502 microversion: 2.1 time: 0.175355 Jul 11 14:15:42.007914 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 126/244] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:41 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:42.029866 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a7edba5e-8c94-4f59-839c-2b22c8157346 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01d02858-70fe-4a1e-8c3b-b1ff94ee0243"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:42.031051 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a7edba5e-8c94-4f59-839c-2b22c8157346 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:42.046885 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7edba5e-8c94-4f59-839c-2b22c8157346 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:42.046885 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7edba5e-8c94-4f59-839c-2b22c8157346 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:42.047398 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7edba5e-8c94-4f59-839c-2b22c8157346 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:42.047542 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7edba5e-8c94-4f59-839c-2b22c8157346 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:42.100468 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-a7edba5e-8c94-4f59-839c-2b22c8157346 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] HTTP exception thrown: Cannot 'attach_volume' instance ce9c0371-22ec-432a-9835-696bc61b05de while it is in vm_state rescued Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a7edba5e-8c94-4f59-839c-2b22c8157346 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Request method failure captured: Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: POST /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de/os-volume_attachments HTTP/1.1 Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 74 Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDACP6mdhrBbHb9S3XX22Eb0vYXjhp1e_LptzxBkzLwvBvJ1-7gB1TqSdpdJ5YeHgf2tmnMDlqCnoElwnEKtizDSMd2V06J3G6UnMcuGg7PNEVrEt6Rrsspv6l6ei_5BXqbOVaeGYCCinqLdi82bSV7C8J2_OU2nV_ohEovCqh80m6I Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 15d95b0cae244d99885be229335ea541 Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1246670355 Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:15:42.104592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:15:42.106277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15d95b0cae244d99885be229335ea541"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15d95b0cae244d99885be229335ea541"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15d95b0cae244d99885be229335ea541"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15d95b0cae244d99885be229335ea541"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:15:42.106277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1246670355 Jul 11 14:15:42.106277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 15d95b0cae244d99885be229335ea541 Jul 11 14:15:42.106277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1246670355 Jul 11 14:15:42.106277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-ServerRescueNegativeTestJSON-1246670355-project Jul 11 14:15:42.106277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:15:42.106277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:15:42.106277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 39a5cea0a591453581a9d98ff796d973 Jul 11 14:15:42.106277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1246670355-project Jul 11 14:15:42.106277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Jul 11 14:15:42.106277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {"volumeAttachment": {"volumeId": "01d02858-70fe-4a1e-8c3b-b1ff94ee0243"}} Jul 11 14:15:42.106277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Cannot 'attach_volume' instance ce9c0371-22ec-432a-9835-696bc61b05de while it is in vm_state rescued Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'server_id': 'ce9c0371-22ec-432a-9835-696bc61b05de', 'body': {'volumeAttachment': {'volumeId': '01d02858-70fe-4a1e-8c3b-b1ff94ee0243'}}} Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ce9c0371-22ec-432a-9835-696bc61b05de in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:15:42.107430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ce9c0371-22ec-432a-9835-696bc61b05de while it is in vm_state rescued Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:15:42.108876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:15:42.110483 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:15:42.110483 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:15:42.110483 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ce9c0371-22ec-432a-9835-696bc61b05de while it is in vm_state rescued Jul 11 14:15:42.110483 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:15:42.112478 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a7edba5e-8c94-4f59-839c-2b22c8157346 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Returning 409 to user: Cannot 'attach_volume' instance ce9c0371-22ec-432a-9835-696bc61b05de while it is in vm_state rescued {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:15:42.113701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a7edba5e-8c94-4f59-839c-2b22c8157346 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "POST /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.088708 Jul 11 14:15:42.118692 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 127/245] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 11 14:15:42 2022] POST /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de/os-volume_attachments => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 11 14:15:42.125195 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-994b395e-aed4-488d-9bb3-c7f639fe6ce0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:42.126052 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-994b395e-aed4-488d-9bb3-c7f639fe6ce0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:42.139303 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-994b395e-aed4-488d-9bb3-c7f639fe6ce0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:42.139942 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-994b395e-aed4-488d-9bb3-c7f639fe6ce0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:42.140904 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-994b395e-aed4-488d-9bb3-c7f639fe6ce0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:42.142051 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-994b395e-aed4-488d-9bb3-c7f639fe6ce0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:42.201850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-87e10f01-4858-4232-a5ba-6e1c374d2dba tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Going to try to stop instance {{(pid=117921) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 11 14:15:42.241953 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-994b395e-aed4-488d-9bb3-c7f639fe6ce0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "POST /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de/action" status: 202 len: 0 microversion: 2.1 time: 0.121556 Jul 11 14:15:42.242879 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 128/246] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 11 14:15:42 2022] POST /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:15:42.253405 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fdabe7a7-8074-46fe-9f5e-d5be2cda1f91 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:42.254323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fdabe7a7-8074-46fe-9f5e-d5be2cda1f91 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:42.261558 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-87e10f01-4858-4232-a5ba-6e1c374d2dba tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "POST /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27/action" status: 202 len: 0 microversion: 2.1 time: 0.307903 Jul 11 14:15:42.262254 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fdabe7a7-8074-46fe-9f5e-d5be2cda1f91 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:42.262972 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 119/247] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 11 14:15:41 2022] POST /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:15:42.263119 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fdabe7a7-8074-46fe-9f5e-d5be2cda1f91 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:42.263786 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fdabe7a7-8074-46fe-9f5e-d5be2cda1f91 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:42.264221 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fdabe7a7-8074-46fe-9f5e-d5be2cda1f91 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:42.273078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-65d93036-ff69-4483-bf72-b5f0ede30961 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:42.273810 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-65d93036-ff69-4483-bf72-b5f0ede30961 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:42.280030 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-65d93036-ff69-4483-bf72-b5f0ede30961 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:42.280486 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-65d93036-ff69-4483-bf72-b5f0ede30961 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:42.281251 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-65d93036-ff69-4483-bf72-b5f0ede30961 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:42.281684 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-65d93036-ff69-4483-bf72-b5f0ede30961 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:42.432442 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fdabe7a7-8074-46fe-9f5e-d5be2cda1f91 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:42.457552 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-65d93036-ff69-4483-bf72-b5f0ede30961 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:42.467835 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-65d93036-ff69-4483-bf72-b5f0ede30961 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.198800 Jul 11 14:15:42.468849 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 120/248] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:42 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:42.473115 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fdabe7a7-8074-46fe-9f5e-d5be2cda1f91 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1510 microversion: 2.1 time: 0.224133 Jul 11 14:15:42.474408 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 129/249] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:42 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1510 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:15:42.677541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2665a31e-094b-4e34-9d8e-b065c959bded tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:42.678895 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2665a31e-094b-4e34-9d8e-b065c959bded tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:42.685293 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2665a31e-094b-4e34-9d8e-b065c959bded tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:42.685731 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2665a31e-094b-4e34-9d8e-b065c959bded tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:42.686527 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2665a31e-094b-4e34-9d8e-b065c959bded tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:42.687192 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2665a31e-094b-4e34-9d8e-b065c959bded tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:42.921375 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2665a31e-094b-4e34-9d8e-b065c959bded tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:42.931109 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2665a31e-094b-4e34-9d8e-b065c959bded tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1314 microversion: 2.1 time: 0.257646 Jul 11 14:15:42.932374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 121/250] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:42 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:43.489530 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c1ee8b8c-e9ff-493f-ae52-1ecd602ad11f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:43.490243 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c1ee8b8c-e9ff-493f-ae52-1ecd602ad11f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:43.496291 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d4833fc5-14b3-42c0-b3d5-8df77b4a3210 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:43.497496 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d4833fc5-14b3-42c0-b3d5-8df77b4a3210 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:43.499245 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1ee8b8c-e9ff-493f-ae52-1ecd602ad11f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:43.499701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1ee8b8c-e9ff-493f-ae52-1ecd602ad11f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:43.500493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1ee8b8c-e9ff-493f-ae52-1ecd602ad11f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:43.502456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1ee8b8c-e9ff-493f-ae52-1ecd602ad11f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:43.512678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d4833fc5-14b3-42c0-b3d5-8df77b4a3210 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:43.513132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d4833fc5-14b3-42c0-b3d5-8df77b4a3210 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:43.517678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d4833fc5-14b3-42c0-b3d5-8df77b4a3210 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:43.518462 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d4833fc5-14b3-42c0-b3d5-8df77b4a3210 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:43.690615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c1ee8b8c-e9ff-493f-ae52-1ecd602ad11f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:43.693540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d4833fc5-14b3-42c0-b3d5-8df77b4a3210 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:43.701598 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c1ee8b8c-e9ff-493f-ae52-1ecd602ad11f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.217579 Jul 11 14:15:43.704135 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d4833fc5-14b3-42c0-b3d5-8df77b4a3210 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1510 microversion: 2.1 time: 0.215686 Jul 11 14:15:43.704874 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 130/251] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:43 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:43.706429 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 122/252] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:43 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1510 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:43.948896 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-13dc3768-b348-4cff-9708-fee6154d3387 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:43.949547 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-13dc3768-b348-4cff-9708-fee6154d3387 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:43.956662 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13dc3768-b348-4cff-9708-fee6154d3387 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:43.957210 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13dc3768-b348-4cff-9708-fee6154d3387 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:43.958001 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13dc3768-b348-4cff-9708-fee6154d3387 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:43.958535 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13dc3768-b348-4cff-9708-fee6154d3387 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:44.096770 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-13dc3768-b348-4cff-9708-fee6154d3387 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:44.104435 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-13dc3768-b348-4cff-9708-fee6154d3387 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1314 microversion: 2.1 time: 0.159433 Jul 11 14:15:44.105111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 131/253] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:43 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:44.723251 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bd8e25d7-545c-4676-9a0e-967f941fa8a8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:44.723982 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bd8e25d7-545c-4676-9a0e-967f941fa8a8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:44.730720 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd8e25d7-545c-4676-9a0e-967f941fa8a8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:44.731209 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd8e25d7-545c-4676-9a0e-967f941fa8a8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:44.732171 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd8e25d7-545c-4676-9a0e-967f941fa8a8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:44.732765 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd8e25d7-545c-4676-9a0e-967f941fa8a8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:44.737814 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-94be17f3-0735-4b35-b50f-4ccd04ded134 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:44.738863 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-94be17f3-0735-4b35-b50f-4ccd04ded134 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:44.749612 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94be17f3-0735-4b35-b50f-4ccd04ded134 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:44.750560 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94be17f3-0735-4b35-b50f-4ccd04ded134 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:44.751883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94be17f3-0735-4b35-b50f-4ccd04ded134 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:44.752839 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94be17f3-0735-4b35-b50f-4ccd04ded134 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:44.881336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bd8e25d7-545c-4676-9a0e-967f941fa8a8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:44.893087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bd8e25d7-545c-4676-9a0e-967f941fa8a8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.174755 Jul 11 14:15:44.893677 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 123/254] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:44 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:44.917555 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-94be17f3-0735-4b35-b50f-4ccd04ded134 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:44.926511 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-94be17f3-0735-4b35-b50f-4ccd04ded134 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1510 microversion: 2.1 time: 0.197471 Jul 11 14:15:44.927479 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 132/255] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:44 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:45.122631 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-23ac3ec8-236d-4465-8a65-daa088f55706 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:45.123278 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-23ac3ec8-236d-4465-8a65-daa088f55706 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:45.130468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23ac3ec8-236d-4465-8a65-daa088f55706 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:45.130916 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23ac3ec8-236d-4465-8a65-daa088f55706 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:45.131688 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23ac3ec8-236d-4465-8a65-daa088f55706 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:45.132115 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23ac3ec8-236d-4465-8a65-daa088f55706 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:45.147776 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:45.358356 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-23ac3ec8-236d-4465-8a65-daa088f55706 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:45.367033 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-23ac3ec8-236d-4465-8a65-daa088f55706 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1314 microversion: 2.1 time: 0.248172 Jul 11 14:15:45.367615 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 124/256] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:45 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:45.911803 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a893b4ba-65c8-4a4d-b318-5a175b5f3bdf tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:45.913248 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a893b4ba-65c8-4a4d-b318-5a175b5f3bdf tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:45.915805 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=10 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:45.923508 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a893b4ba-65c8-4a4d-b318-5a175b5f3bdf tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:45.924213 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a893b4ba-65c8-4a4d-b318-5a175b5f3bdf tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:45.925158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a893b4ba-65c8-4a4d-b318-5a175b5f3bdf tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:45.925752 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a893b4ba-65c8-4a4d-b318-5a175b5f3bdf tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:45.952867 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2421bfcb-792a-4159-a4f9-b11a2089c8af tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:45.955413 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2421bfcb-792a-4159-a4f9-b11a2089c8af tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:45.962967 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2421bfcb-792a-4159-a4f9-b11a2089c8af tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:45.963505 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2421bfcb-792a-4159-a4f9-b11a2089c8af tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:45.964374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2421bfcb-792a-4159-a4f9-b11a2089c8af tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:45.964909 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2421bfcb-792a-4159-a4f9-b11a2089c8af tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:46.133722 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2421bfcb-792a-4159-a4f9-b11a2089c8af tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:46.144694 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2421bfcb-792a-4159-a4f9-b11a2089c8af tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1510 microversion: 2.1 time: 0.202247 Jul 11 14:15:46.157873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 125/257] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:45 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1510 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:46.200384 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a893b4ba-65c8-4a4d-b318-5a175b5f3bdf tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:46.210077 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a893b4ba-65c8-4a4d-b318-5a175b5f3bdf tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.303265 Jul 11 14:15:46.210706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 133/258] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:45 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:46.388910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4ec4037c-feaa-452c-a1f2-1580e0d2f20d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:46.389836 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4ec4037c-feaa-452c-a1f2-1580e0d2f20d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:46.397021 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ec4037c-feaa-452c-a1f2-1580e0d2f20d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:46.399161 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ec4037c-feaa-452c-a1f2-1580e0d2f20d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:46.400251 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ec4037c-feaa-452c-a1f2-1580e0d2f20d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:46.400972 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ec4037c-feaa-452c-a1f2-1580e0d2f20d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:46.553064 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4ec4037c-feaa-452c-a1f2-1580e0d2f20d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:46.562717 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4ec4037c-feaa-452c-a1f2-1580e0d2f20d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1314 microversion: 2.1 time: 0.178033 Jul 11 14:15:46.564271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 126/259] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:46 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:47.164065 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dbe9803f-63f9-4750-ba3b-5b320b704d94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:47.164995 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dbe9803f-63f9-4750-ba3b-5b320b704d94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:47.171494 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dbe9803f-63f9-4750-ba3b-5b320b704d94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:47.171986 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dbe9803f-63f9-4750-ba3b-5b320b704d94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:47.173164 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dbe9803f-63f9-4750-ba3b-5b320b704d94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:47.173580 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dbe9803f-63f9-4750-ba3b-5b320b704d94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:47.227636 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-81daaa11-9908-4fda-a41a-a0bfc3387084 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:47.229064 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-81daaa11-9908-4fda-a41a-a0bfc3387084 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:47.236775 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81daaa11-9908-4fda-a41a-a0bfc3387084 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:47.237571 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81daaa11-9908-4fda-a41a-a0bfc3387084 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:47.238631 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81daaa11-9908-4fda-a41a-a0bfc3387084 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:47.239324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81daaa11-9908-4fda-a41a-a0bfc3387084 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:47.436552 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dbe9803f-63f9-4750-ba3b-5b320b704d94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:47.453161 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dbe9803f-63f9-4750-ba3b-5b320b704d94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1510 microversion: 2.1 time: 0.292536 Jul 11 14:15:47.455194 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 134/260] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:47 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1510 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:47.470488 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-81daaa11-9908-4fda-a41a-a0bfc3387084 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:47.480454 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-81daaa11-9908-4fda-a41a-a0bfc3387084 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.256540 Jul 11 14:15:47.482416 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 127/261] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:47 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:15:47.583633 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-80f44766-e7a7-480f-919a-c58c22d44ce5 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:47.584417 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-80f44766-e7a7-480f-919a-c58c22d44ce5 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:47.594776 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80f44766-e7a7-480f-919a-c58c22d44ce5 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:47.595408 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80f44766-e7a7-480f-919a-c58c22d44ce5 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:47.596014 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80f44766-e7a7-480f-919a-c58c22d44ce5 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:47.596457 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80f44766-e7a7-480f-919a-c58c22d44ce5 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:47.765921 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-80f44766-e7a7-480f-919a-c58c22d44ce5 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:47.775401 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-80f44766-e7a7-480f-919a-c58c22d44ce5 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1314 microversion: 2.1 time: 0.198260 Jul 11 14:15:47.775993 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 135/262] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:47 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:48.483431 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7e8b351c-468a-436b-8e7f-3200935e878e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:48.484484 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7e8b351c-468a-436b-8e7f-3200935e878e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:48.498090 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bd86ec10-0da3-4753-8db3-1fd70de4fc75 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:48.498755 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bd86ec10-0da3-4753-8db3-1fd70de4fc75 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:48.503502 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=52 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:48.509418 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd86ec10-0da3-4753-8db3-1fd70de4fc75 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:48.518878 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e8b351c-468a-436b-8e7f-3200935e878e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:48.519366 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e8b351c-468a-436b-8e7f-3200935e878e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:48.520216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e8b351c-468a-436b-8e7f-3200935e878e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:48.520662 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e8b351c-468a-436b-8e7f-3200935e878e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:48.528760 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd86ec10-0da3-4753-8db3-1fd70de4fc75 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:48.529547 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd86ec10-0da3-4753-8db3-1fd70de4fc75 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:48.529988 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd86ec10-0da3-4753-8db3-1fd70de4fc75 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:48.980129 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd86ec10-0da3-4753-8db3-1fd70de4fc75 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:48.984755 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7e8b351c-468a-436b-8e7f-3200935e878e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:48.995142 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bd86ec10-0da3-4753-8db3-1fd70de4fc75 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.500729 Jul 11 14:15:48.995798 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7e8b351c-468a-436b-8e7f-3200935e878e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1516 microversion: 2.1 time: 0.515980 Jul 11 14:15:48.996576 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 136/264] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:48 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:48.996691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 128/264] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:48 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1516 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:49.001808 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-92f5e743-743a-49a3-af42-3d83e25c8203 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:49.002457 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-92f5e743-743a-49a3-af42-3d83e25c8203 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:49.003245 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-d807e733-2eb7-4cba-a6c8-efda3fed37c9 req-777f13ae-3bfa-4722-b884-dfcbf4ee63a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2218505-9930-439d-9bb5-c8061c5cfb63", "name": "network-vif-plugged", "status": "completed", "tag": "d60a00df-b670-47d2-b620-c664c77d9bbe"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:49.009824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-92f5e743-743a-49a3-af42-3d83e25c8203 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:49.011304 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-92f5e743-743a-49a3-af42-3d83e25c8203 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:49.012544 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-92f5e743-743a-49a3-af42-3d83e25c8203 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:49.013533 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-92f5e743-743a-49a3-af42-3d83e25c8203 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:49.022578 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d807e733-2eb7-4cba-a6c8-efda3fed37c9 req-777f13ae-3bfa-4722-b884-dfcbf4ee63a8 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:49.023334 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d807e733-2eb7-4cba-a6c8-efda3fed37c9 req-777f13ae-3bfa-4722-b884-dfcbf4ee63a8 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:49.042950 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-d807e733-2eb7-4cba-a6c8-efda3fed37c9 req-777f13ae-3bfa-4722-b884-dfcbf4ee63a8 service nova] Creating event network-vif-plugged:d60a00df-b670-47d2-b620-c664c77d9bbe for instance e2218505-9930-439d-9bb5-c8061c5cfb63 on hv-cinder-81914 Jul 11 14:15:49.067906 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-d807e733-2eb7-4cba-a6c8-efda3fed37c9 req-777f13ae-3bfa-4722-b884-dfcbf4ee63a8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069541 Jul 11 14:15:49.069958 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 137/265] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:15:49.362714 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-92f5e743-743a-49a3-af42-3d83e25c8203 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:49.385548 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-92f5e743-743a-49a3-af42-3d83e25c8203 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1314 microversion: 2.1 time: 0.377208 Jul 11 14:15:49.388027 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 129/266] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:48 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:50.014567 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0f86bac4-c70e-442f-b6e7-34a8d13be6de tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:50.015335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0f86bac4-c70e-442f-b6e7-34a8d13be6de tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:50.023677 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f86bac4-c70e-442f-b6e7-34a8d13be6de tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:50.024139 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f86bac4-c70e-442f-b6e7-34a8d13be6de tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:50.025013 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f86bac4-c70e-442f-b6e7-34a8d13be6de tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:50.025460 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f86bac4-c70e-442f-b6e7-34a8d13be6de tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:50.046595 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:50.190611 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0f86bac4-c70e-442f-b6e7-34a8d13be6de tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:50.201979 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0f86bac4-c70e-442f-b6e7-34a8d13be6de tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.192554 Jul 11 14:15:50.202862 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 138/267] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:50 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:50.403811 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0802461e-62ab-498c-9a54-b3f5b40ee5d6 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:50.404428 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0802461e-62ab-498c-9a54-b3f5b40ee5d6 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:50.412402 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0802461e-62ab-498c-9a54-b3f5b40ee5d6 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:50.412853 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0802461e-62ab-498c-9a54-b3f5b40ee5d6 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:50.413663 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0802461e-62ab-498c-9a54-b3f5b40ee5d6 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:50.414099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0802461e-62ab-498c-9a54-b3f5b40ee5d6 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:50.561932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bec5a61f-72d9-4482-a096-a59b3536a8ca tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Action: 'create', calling method: .version_select at 0x7fc97c0188b0>, body: {"keypair": {"name": "tempest-keypair-1090503969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWWkfJoMmUitSaf6O66Osizp69qnZEujK4AlBNlvZ1v1ez5Z9lgKB2IyodoSWwPJxbsw9WGJIOwwlej8e6xQF8gdbcynLSYG6A9VuC5ST2BUSrErdLPc5ngVeOuWMXTJw=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:50.579690 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-bec5a61f-72d9-4482-a096-a59b3536a8ca tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Getting quotas for project 15d95b0cae244d99885be229335ea541. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:15:50.584177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-bec5a61f-72d9-4482-a096-a59b3536a8ca tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Getting quotas for user 39a5cea0a591453581a9d98ff796d973 and project 15d95b0cae244d99885be229335ea541. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:15:50.599924 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0802461e-62ab-498c-9a54-b3f5b40ee5d6 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:50.609115 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bec5a61f-72d9-4482-a096-a59b3536a8ca tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051029 Jul 11 14:15:50.610974 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0802461e-62ab-498c-9a54-b3f5b40ee5d6 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1314 microversion: 2.1 time: 0.211003 Jul 11 14:15:50.620043 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 139/268] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 11 14:15:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:15:50.621529 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 130/269] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:50 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:51.224950 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d0ee712f-f48f-45ab-8014-548f7379255b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:51.225740 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d0ee712f-f48f-45ab-8014-548f7379255b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:51.244307 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0ee712f-f48f-45ab-8014-548f7379255b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:51.245366 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0ee712f-f48f-45ab-8014-548f7379255b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:51.246729 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0ee712f-f48f-45ab-8014-548f7379255b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:51.247571 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0ee712f-f48f-45ab-8014-548f7379255b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:51.605863 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d0ee712f-f48f-45ab-8014-548f7379255b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:51.618224 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d0ee712f-f48f-45ab-8014-548f7379255b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.401282 Jul 11 14:15:51.618878 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 140/270] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:51 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:51.629169 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-db5c563b-a911-4d80-bb2c-a5eeacaccd8f tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:51.630834 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-db5c563b-a911-4d80-bb2c-a5eeacaccd8f tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:51.639621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db5c563b-a911-4d80-bb2c-a5eeacaccd8f tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:51.640275 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db5c563b-a911-4d80-bb2c-a5eeacaccd8f tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:51.641726 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db5c563b-a911-4d80-bb2c-a5eeacaccd8f tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:51.642449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db5c563b-a911-4d80-bb2c-a5eeacaccd8f tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:51.858603 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-db5c563b-a911-4d80-bb2c-a5eeacaccd8f tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:51.871833 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-db5c563b-a911-4d80-bb2c-a5eeacaccd8f tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1498 microversion: 2.1 time: 0.247502 Jul 11 14:15:51.872851 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 131/271] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:51 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1498 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:52.637200 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-142fac69-cbec-4af9-b3b4-5ca6eeda4550 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:52.637769 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-142fac69-cbec-4af9-b3b4-5ca6eeda4550 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:52.647832 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-142fac69-cbec-4af9-b3b4-5ca6eeda4550 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:52.648288 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-142fac69-cbec-4af9-b3b4-5ca6eeda4550 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:52.649092 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-142fac69-cbec-4af9-b3b4-5ca6eeda4550 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:52.649522 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-142fac69-cbec-4af9-b3b4-5ca6eeda4550 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:52.672229 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a7045d74-6c72-482c-87aa-b9157c250fdd tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:52.672983 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a7045d74-6c72-482c-87aa-b9157c250fdd tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:52.683181 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7045d74-6c72-482c-87aa-b9157c250fdd tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:52.683639 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7045d74-6c72-482c-87aa-b9157c250fdd tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:52.684600 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7045d74-6c72-482c-87aa-b9157c250fdd tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:52.685230 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7045d74-6c72-482c-87aa-b9157c250fdd tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:52.724462 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a7045d74-6c72-482c-87aa-b9157c250fdd tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:15:52.867408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a7045d74-6c72-482c-87aa-b9157c250fdd tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 204 len: 0 microversion: 2.1 time: 0.198642 Jul 11 14:15:52.868013 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 132/272] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:15:52 2022] DELETE /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:15:52.886616 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-19e203f1-7f8c-4b71-8858-a2019579700f tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:52.887576 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-19e203f1-7f8c-4b71-8858-a2019579700f tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:52.898834 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19e203f1-7f8c-4b71-8858-a2019579700f tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:52.899417 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19e203f1-7f8c-4b71-8858-a2019579700f tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:52.900387 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19e203f1-7f8c-4b71-8858-a2019579700f tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:52.900827 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19e203f1-7f8c-4b71-8858-a2019579700f tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:53.200062 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-142fac69-cbec-4af9-b3b4-5ca6eeda4550 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:53.223022 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-142fac69-cbec-4af9-b3b4-5ca6eeda4550 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.589380 Jul 11 14:15:53.236666 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 141/273] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:52 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:53.420950 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7a02223a-9862-41f8-bfe8-cb50a734e179 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1351465427", "imageRef": "67874ac7-fac8-4d6d-9cd1-9091ecb957b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "53933bc7-750b-4043-bebb-e444933bfa00"}], "security_groups": [{"name": "tempest-securitygroup--1551048330"}], "key_name": "tempest-keypair-1090503969", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:53.458258 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-19e203f1-7f8c-4b71-8858-a2019579700f tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:53.472703 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-19e203f1-7f8c-4b71-8858-a2019579700f tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1504 microversion: 2.1 time: 0.593750 Jul 11 14:15:53.475279 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 133/274] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:52 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1504 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:53.666713 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-7a02223a-9862-41f8-bfe8-cb50a734e179 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] validate_networks() for [('53933bc7-750b-4043-bebb-e444933bfa00', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:15:54.242227 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ef16f23e-3e92-43ef-81ad-4c4da68c4a1f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:54.243739 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ef16f23e-3e92-43ef-81ad-4c4da68c4a1f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:54.267097 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef16f23e-3e92-43ef-81ad-4c4da68c4a1f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:54.267856 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef16f23e-3e92-43ef-81ad-4c4da68c4a1f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:54.269220 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef16f23e-3e92-43ef-81ad-4c4da68c4a1f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:54.269811 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef16f23e-3e92-43ef-81ad-4c4da68c4a1f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:54.407105 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-7a02223a-9862-41f8-bfe8-cb50a734e179 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:15:54.416125 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-7a02223a-9862-41f8-bfe8-cb50a734e179 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:15:54.416746 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-7a02223a-9862-41f8-bfe8-cb50a734e179 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:15:54.417311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-7a02223a-9862-41f8-bfe8-cb50a734e179 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:15:54.417941 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-7a02223a-9862-41f8-bfe8-cb50a734e179 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:15:54.429049 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a02223a-9862-41f8-bfe8-cb50a734e179 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:54.430055 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a02223a-9862-41f8-bfe8-cb50a734e179 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:54.431302 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a02223a-9862-41f8-bfe8-cb50a734e179 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:54.432146 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a02223a-9862-41f8-bfe8-cb50a734e179 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:54.452822 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-7a02223a-9862-41f8-bfe8-cb50a734e179 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Getting quotas for project 15d95b0cae244d99885be229335ea541. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:15:54.457943 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-7a02223a-9862-41f8-bfe8-cb50a734e179 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Getting quotas for user 39a5cea0a591453581a9d98ff796d973 and project 15d95b0cae244d99885be229335ea541. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:15:54.479524 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:54.483293 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7a02223a-9862-41f8-bfe8-cb50a734e179 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:15:54.488083 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7a02223a-9862-41f8-bfe8-cb50a734e179 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67874ac7-fac8-4d6d-9cd1-9091ecb957b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:15:54.561822 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7a02223a-9862-41f8-bfe8-cb50a734e179 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.156694 Jul 11 14:15:54.568925 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 142/275] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:15:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 11 14:15:54.574624 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4b6fe4d9-7496-471d-964d-9f241c114f91 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:54.575525 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4b6fe4d9-7496-471d-964d-9f241c114f91 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:54.582830 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b6fe4d9-7496-471d-964d-9f241c114f91 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:54.583790 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b6fe4d9-7496-471d-964d-9f241c114f91 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:54.584801 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b6fe4d9-7496-471d-964d-9f241c114f91 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:54.585440 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b6fe4d9-7496-471d-964d-9f241c114f91 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:54.880970 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b6fe4d9-7496-471d-964d-9f241c114f91 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:54.893630 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4b6fe4d9-7496-471d-964d-9f241c114f91 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1504 microversion: 2.1 time: 0.320123 Jul 11 14:15:54.897662 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 143/276] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:54 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:54.911008 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-efdb524b-7cc6-469e-86e6-76b96d47b9bf tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:54.935715 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-efdb524b-7cc6-469e-86e6-76b96d47b9bf tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:55.010514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-efdb524b-7cc6-469e-86e6-76b96d47b9bf tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:55.023899 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-efdb524b-7cc6-469e-86e6-76b96d47b9bf tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1246 microversion: 2.1 time: 0.121863 Jul 11 14:15:55.026521 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 144/277] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:54 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1246 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:55.191657 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ef16f23e-3e92-43ef-81ad-4c4da68c4a1f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:55.202101 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ef16f23e-3e92-43ef-81ad-4c4da68c4a1f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.964656 Jul 11 14:15:55.209283 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 134/278] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:54 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:15:55.913970 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-445cb81c-ceba-4c88-92aa-9ad385172321 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:55.915780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-445cb81c-ceba-4c88-92aa-9ad385172321 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:55.925032 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-445cb81c-ceba-4c88-92aa-9ad385172321 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:55.925794 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-445cb81c-ceba-4c88-92aa-9ad385172321 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:55.926799 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-445cb81c-ceba-4c88-92aa-9ad385172321 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:55.927244 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-445cb81c-ceba-4c88-92aa-9ad385172321 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:56.044508 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d780f2d5-f8ca-4ec7-9d97-3678d37b6395 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:56.046358 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d780f2d5-f8ca-4ec7-9d97-3678d37b6395 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:56.052415 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-445cb81c-ceba-4c88-92aa-9ad385172321 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:56.071528 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d780f2d5-f8ca-4ec7-9d97-3678d37b6395 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:56.072288 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-445cb81c-ceba-4c88-92aa-9ad385172321 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 200 len: 1462 microversion: 2.1 time: 0.158988 Jul 11 14:15:56.073158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 145/279] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:55 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 1462 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:56.073978 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d780f2d5-f8ca-4ec7-9d97-3678d37b6395 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:56.075468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d780f2d5-f8ca-4ec7-9d97-3678d37b6395 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:56.076477 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d780f2d5-f8ca-4ec7-9d97-3678d37b6395 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:56.154885 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-e5af938c-89a4-4d9e-9c72-c790caea5405 req-b45f4008-e61b-4b9e-bd24-94fc79fdfb91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2218505-9930-439d-9bb5-c8061c5cfb63", "name": "network-vif-deleted", "tag": "d60a00df-b670-47d2-b620-c664c77d9bbe"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:56.179437 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e5af938c-89a4-4d9e-9c72-c790caea5405 req-b45f4008-e61b-4b9e-bd24-94fc79fdfb91 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:56.180198 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e5af938c-89a4-4d9e-9c72-c790caea5405 req-b45f4008-e61b-4b9e-bd24-94fc79fdfb91 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:56.224077 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-e5af938c-89a4-4d9e-9c72-c790caea5405 req-b45f4008-e61b-4b9e-bd24-94fc79fdfb91 service nova] Creating event network-vif-deleted:d60a00df-b670-47d2-b620-c664c77d9bbe for instance e2218505-9930-439d-9bb5-c8061c5cfb63 on hv-cinder-81914 Jul 11 14:15:56.230327 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-e5af938c-89a4-4d9e-9c72-c790caea5405 req-b45f4008-e61b-4b9e-bd24-94fc79fdfb91 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079272 Jul 11 14:15:56.231981 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 146/280] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:15:56.238553 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-19c874d2-5229-4b48-8ecc-eff456c7cc1c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:56.239273 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-19c874d2-5229-4b48-8ecc-eff456c7cc1c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:56.246322 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19c874d2-5229-4b48-8ecc-eff456c7cc1c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:56.246862 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19c874d2-5229-4b48-8ecc-eff456c7cc1c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:56.249650 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19c874d2-5229-4b48-8ecc-eff456c7cc1c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:56.251324 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19c874d2-5229-4b48-8ecc-eff456c7cc1c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:56.478312 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d780f2d5-f8ca-4ec7-9d97-3678d37b6395 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:56.506395 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d780f2d5-f8ca-4ec7-9d97-3678d37b6395 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1298 microversion: 2.1 time: 0.459700 Jul 11 14:15:56.507094 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 135/281] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:56 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1298 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:15:56.547996 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-19c874d2-5229-4b48-8ecc-eff456c7cc1c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:56.560754 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-19c874d2-5229-4b48-8ecc-eff456c7cc1c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.324368 Jul 11 14:15:56.574646 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 147/282] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:56 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:57.091404 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3d385a72-c8f8-42d0-af06-6f9185929a7d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:57.093313 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3d385a72-c8f8-42d0-af06-6f9185929a7d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: e2218505-9930-439d-9bb5-c8061c5cfb63] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:57.105535 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d385a72-c8f8-42d0-af06-6f9185929a7d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:57.106774 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d385a72-c8f8-42d0-af06-6f9185929a7d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:57.110333 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d385a72-c8f8-42d0-af06-6f9185929a7d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:57.111146 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d385a72-c8f8-42d0-af06-6f9185929a7d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:57.134361 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-3d385a72-c8f8-42d0-af06-6f9185929a7d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] HTTP exception thrown: Instance e2218505-9930-439d-9bb5-c8061c5cfb63 could not be found. Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3d385a72-c8f8-42d0-af06-6f9185929a7d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Request method failure captured: Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 HTTP/1.1 Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDB72exfDX6CD0-Nd8Hrq2jtty3plMX6A2-AsSEScnmMPX43OGNsQVxclDqB1VjPDTSm1cXc0QDw_iGPX09mVRgOumGuok5t9SjjyWetWAz80lU4ECMv7GvLtx4V0R9k-4GNkZ8eYat_9IdNi0iIXpbozu6lGSHRFpjPZyBVpSNbRm0 Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: bdc81783ff1f4a47b617e77618303f94 Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesActionsTest-1989461559 Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:15:57.137099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:15:57.138530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bdc81783ff1f4a47b617e77618303f94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bdc81783ff1f4a47b617e77618303f94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bdc81783ff1f4a47b617e77618303f94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bdc81783ff1f4a47b617e77618303f94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:15:57.138530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesActionsTest-1989461559 Jul 11 14:15:57.138530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: bdc81783ff1f4a47b617e77618303f94 Jul 11 14:15:57.138530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesActionsTest-1989461559 Jul 11 14:15:57.138530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesActionsTest-1989461559-project Jul 11 14:15:57.138530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:15:57.138530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:15:57.138530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: bf2b65c48bc141abbd3c56b791b213ae Jul 11 14:15:57.138530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesActionsTest-1989461559-project Jul 11 14:15:57.138530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:15:57.138530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance e2218505-9930-439d-9bb5-c8061c5cfb63 could not be found. Jul 11 14:15:57.138530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': 'e2218505-9930-439d-9bb5-c8061c5cfb63'} Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2218505-9930-439d-9bb5-c8061c5cfb63 could not be found. Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:15:57.139271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:15:57.140586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:15:57.140586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:15:57.140586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:15:57.140586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:15:57.140586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:15:57.140586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:15:57.140586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:15:57.140586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2218505-9930-439d-9bb5-c8061c5cfb63 could not be found. Jul 11 14:15:57.140586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:15:57.140586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:15:57.140586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:15:57.140586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:15:57.140586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:15:57.140586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:15:57.140586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:15:57.140586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:15:57.140586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2218505-9930-439d-9bb5-c8061c5cfb63 could not be found. Jul 11 14:15:57.140586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:15:57.141667 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3d385a72-c8f8-42d0-af06-6f9185929a7d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Returning 404 to user: Instance e2218505-9930-439d-9bb5-c8061c5cfb63 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:15:57.141667 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3d385a72-c8f8-42d0-af06-6f9185929a7d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63" status: 404 len: 111 microversion: 2.1 time: 0.051727 Jul 11 14:15:57.150530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 136/283] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:57 2022] GET /compute/v2.1/servers/e2218505-9930-439d-9bb5-c8061c5cfb63 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:15:57.274184 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-679db044-764d-4cc1-be9b-71e7b5fa10a7 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1638372362", "imageRef": "67874ac7-fac8-4d6d-9cd1-9091ecb957b6", "flavorRef": "452", "networks": [{"uuid": "6ff114ce-bbaa-4b1f-83c3-fc24459f1bd0"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:57.300295 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8c314b3b-abb7-4865-a36d-01ecc5d9d766 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-771255165", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1954347746", "security_groups": [{"name": "tempest-secgroup-smoke-940358420"}], "networks": [{"uuid": "2cd049e0-a1ac-4a4b-af64-9acaee0bcfed"}], "block_device_mapping_v2": [{"uuid": "4868d344-9031-453b-8575-bcf31f63845e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:57.352780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-679db044-764d-4cc1-be9b-71e7b5fa10a7 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] validate_networks() for [('6ff114ce-bbaa-4b1f-83c3-fc24459f1bd0', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:15:57.592359 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-8c314b3b-abb7-4865-a36d-01ecc5d9d766 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] validate_networks() for [('2cd049e0-a1ac-4a4b-af64-9acaee0bcfed', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:15:57.765022 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-679db044-764d-4cc1-be9b-71e7b5fa10a7 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:15:57.765744 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-679db044-764d-4cc1-be9b-71e7b5fa10a7 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:15:57.766384 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-679db044-764d-4cc1-be9b-71e7b5fa10a7 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:15:57.766902 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-679db044-764d-4cc1-be9b-71e7b5fa10a7 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:15:57.767440 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-679db044-764d-4cc1-be9b-71e7b5fa10a7 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:15:57.779066 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-679db044-764d-4cc1-be9b-71e7b5fa10a7 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:57.780231 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-679db044-764d-4cc1-be9b-71e7b5fa10a7 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:57.782395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-679db044-764d-4cc1-be9b-71e7b5fa10a7 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:57.783300 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-679db044-764d-4cc1-be9b-71e7b5fa10a7 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:57.807040 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-679db044-764d-4cc1-be9b-71e7b5fa10a7 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Getting quotas for project bdc81783ff1f4a47b617e77618303f94. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:15:57.814417 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-679db044-764d-4cc1-be9b-71e7b5fa10a7 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Getting quotas for user bf2b65c48bc141abbd3c56b791b213ae and project bdc81783ff1f4a47b617e77618303f94. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:15:57.832079 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-679db044-764d-4cc1-be9b-71e7b5fa10a7 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:15:57.834778 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-679db044-764d-4cc1-be9b-71e7b5fa10a7 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67874ac7-fac8-4d6d-9cd1-9091ecb957b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:15:57.904392 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-679db044-764d-4cc1-be9b-71e7b5fa10a7 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634877 Jul 11 14:15:57.906992 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 148/284] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:15:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:15:57.915609 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-289abfa0-02c4-4b9d-90e7-e12c5c7165eb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:57.917375 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-289abfa0-02c4-4b9d-90e7-e12c5c7165eb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:57.929256 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-289abfa0-02c4-4b9d-90e7-e12c5c7165eb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:57.931984 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-289abfa0-02c4-4b9d-90e7-e12c5c7165eb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:57.933116 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-289abfa0-02c4-4b9d-90e7-e12c5c7165eb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:57.934536 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-289abfa0-02c4-4b9d-90e7-e12c5c7165eb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:58.205180 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-289abfa0-02c4-4b9d-90e7-e12c5c7165eb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:58.214198 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-289abfa0-02c4-4b9d-90e7-e12c5c7165eb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1372 microversion: 2.1 time: 0.305246 Jul 11 14:15:58.218209 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 149/285] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:57 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1372 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:58.220117 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a067c241-dd6d-4604-8414-0d52e4869df5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:58.225775 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a067c241-dd6d-4604-8414-0d52e4869df5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:58.233769 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a067c241-dd6d-4604-8414-0d52e4869df5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:58.238438 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a067c241-dd6d-4604-8414-0d52e4869df5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:58.239370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a067c241-dd6d-4604-8414-0d52e4869df5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:58.242656 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a067c241-dd6d-4604-8414-0d52e4869df5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:58.509575 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a067c241-dd6d-4604-8414-0d52e4869df5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:58.519806 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a067c241-dd6d-4604-8414-0d52e4869df5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.303944 Jul 11 14:15:58.530675 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 150/286] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:58 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:58.536530 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1bfb3f57-6514-4f20-81e4-884032f34408 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:58.536956 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1bfb3f57-6514-4f20-81e4-884032f34408 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:58.599821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1bfb3f57-6514-4f20-81e4-884032f34408 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:58.611280 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1bfb3f57-6514-4f20-81e4-884032f34408 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 200 len: 1214 microversion: 2.1 time: 0.078681 Jul 11 14:15:58.612581 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 151/287] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:58 2022] GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:59.232597 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-59cf4deb-7b9f-4d4d-b380-760a3ef1b4d7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:59.233472 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-59cf4deb-7b9f-4d4d-b380-760a3ef1b4d7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:59.241430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59cf4deb-7b9f-4d4d-b380-760a3ef1b4d7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:59.242144 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59cf4deb-7b9f-4d4d-b380-760a3ef1b4d7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:59.243188 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59cf4deb-7b9f-4d4d-b380-760a3ef1b4d7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:59.243785 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59cf4deb-7b9f-4d4d-b380-760a3ef1b4d7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:59.334118 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-8c314b3b-abb7-4865-a36d-01ecc5d9d766 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:15:59.334716 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-8c314b3b-abb7-4865-a36d-01ecc5d9d766 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:15:59.335299 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-8c314b3b-abb7-4865-a36d-01ecc5d9d766 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:15:59.337184 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-8c314b3b-abb7-4865-a36d-01ecc5d9d766 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:15:59.337798 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-8c314b3b-abb7-4865-a36d-01ecc5d9d766 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:15:59.347108 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8c314b3b-abb7-4865-a36d-01ecc5d9d766 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:59.347561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8c314b3b-abb7-4865-a36d-01ecc5d9d766 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:59.348369 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8c314b3b-abb7-4865-a36d-01ecc5d9d766 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:59.348813 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8c314b3b-abb7-4865-a36d-01ecc5d9d766 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:59.370357 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-8c314b3b-abb7-4865-a36d-01ecc5d9d766 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Getting quotas for project 5c6666e112684b9ea973be1c5833b0cb. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:15:59.374796 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-8c314b3b-abb7-4865-a36d-01ecc5d9d766 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Getting quotas for user 8455bd8a1dd841c6bac62b553f06e683 and project 5c6666e112684b9ea973be1c5833b0cb. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:15:59.444932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8c314b3b-abb7-4865-a36d-01ecc5d9d766 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:15:59.447337 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8c314b3b-abb7-4865-a36d-01ecc5d9d766 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4868d344-9031-453b-8575-bcf31f63845e',volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:15:59.474669 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-59cf4deb-7b9f-4d4d-b380-760a3ef1b4d7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:59.482272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-59cf4deb-7b9f-4d4d-b380-760a3ef1b4d7 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1372 microversion: 2.1 time: 0.253603 Jul 11 14:15:59.482862 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 152/288] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:59 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1372 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:15:59.537470 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5f2171f6-7bed-4084-8514-440980b23559 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:59.538145 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5f2171f6-7bed-4084-8514-440980b23559 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:59.544302 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f2171f6-7bed-4084-8514-440980b23559 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:59.544742 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f2171f6-7bed-4084-8514-440980b23559 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:59.545526 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f2171f6-7bed-4084-8514-440980b23559 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:59.545955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f2171f6-7bed-4084-8514-440980b23559 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:59.698473 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8c314b3b-abb7-4865-a36d-01ecc5d9d766 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.400065 Jul 11 14:15:59.699690 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 137/289] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:15:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 2404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:15:59.710475 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cc67c622-bd99-4a72-8693-d55cef052d35 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:59.711104 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cc67c622-bd99-4a72-8693-d55cef052d35 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:59.724828 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc67c622-bd99-4a72-8693-d55cef052d35 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:59.725340 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc67c622-bd99-4a72-8693-d55cef052d35 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:59.726122 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc67c622-bd99-4a72-8693-d55cef052d35 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:59.727264 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc67c622-bd99-4a72-8693-d55cef052d35 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:59.838507 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5f2171f6-7bed-4084-8514-440980b23559 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:59.849691 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5f2171f6-7bed-4084-8514-440980b23559 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.316038 Jul 11 14:15:59.854039 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 153/290] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:59 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:15:59.863654 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-806cf48d-766d-4131-b201-3d2d842c074a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:59.869435 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-806cf48d-766d-4131-b201-3d2d842c074a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:59.944056 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-806cf48d-766d-4131-b201-3d2d842c074a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:59.956964 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-806cf48d-766d-4131-b201-3d2d842c074a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1088 microversion: 2.1 time: 0.101436 Jul 11 14:15:59.958102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 154/291] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:59 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1088 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:00.065773 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cc67c622-bd99-4a72-8693-d55cef052d35 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:00.076453 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cc67c622-bd99-4a72-8693-d55cef052d35 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 200 len: 1272 microversion: 2.1 time: 0.375367 Jul 11 14:16:00.086982 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 138/292] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:59 2022] GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 1272 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:00.498813 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5b64739f-ccca-46b2-a12d-12da8caeb4b5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:00.501549 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5b64739f-ccca-46b2-a12d-12da8caeb4b5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:00.519762 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b64739f-ccca-46b2-a12d-12da8caeb4b5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:00.520490 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b64739f-ccca-46b2-a12d-12da8caeb4b5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:00.521630 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b64739f-ccca-46b2-a12d-12da8caeb4b5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:00.523552 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b64739f-ccca-46b2-a12d-12da8caeb4b5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:00.707642 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-adb819d6-8661-4ffa-bf69-f82b29cb1cdd req-983e7e2a-f4f2-4d13-becc-1a05c1ec27e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "413449f2-c97f-4bb8-a3c8-e8447fe3d1a8", "tag": "8bfd8a36-2339-4c5c-9836-b9d0b3694f20"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:00.726063 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-adb819d6-8661-4ffa-bf69-f82b29cb1cdd req-983e7e2a-f4f2-4d13-becc-1a05c1ec27e2 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:00.728073 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-adb819d6-8661-4ffa-bf69-f82b29cb1cdd req-983e7e2a-f4f2-4d13-becc-1a05c1ec27e2 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:00.774791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-adb819d6-8661-4ffa-bf69-f82b29cb1cdd req-983e7e2a-f4f2-4d13-becc-1a05c1ec27e2 service nova] Creating event network-changed:8bfd8a36-2339-4c5c-9836-b9d0b3694f20 for instance 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 on hv-cinder-81914 Jul 11 14:16:00.790614 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-adb819d6-8661-4ffa-bf69-f82b29cb1cdd req-983e7e2a-f4f2-4d13-becc-1a05c1ec27e2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085816 Jul 11 14:16:00.793601 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 139/293] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:01.112887 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3513a0c1-3a32-4444-a215-93bbffd50aac tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Action: 'create', calling method: .version_select at 0x7fc976dc0790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2127391203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqBHXm/nWB4IWYf9ufQZEA7LXMNqhdU2NibbWLsLM3ipQmSVgAQHKIjLXhcQs+Xkcw6rP2u+PQiyFVM7G7jLXCzs0OL66R6/PTj92qeUqjkCJpqMKKT4T8C6Z0RVMbKrQ=="}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:01.130898 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-3513a0c1-3a32-4444-a215-93bbffd50aac tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Getting quotas for project 8da67a5ec9194e7bad1eb52c45a584bf. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:16:01.135314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-3513a0c1-3a32-4444-a215-93bbffd50aac tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Getting quotas for user 5383a1d1bec34094a1889a86d87a88b5 and project 8da67a5ec9194e7bad1eb52c45a584bf. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:16:01.162658 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3513a0c1-3a32-4444-a215-93bbffd50aac tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.367182 Jul 11 14:16:01.163395 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 140/294] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 11 14:16:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:01.169691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c2aee010-97f4-40d9-a978-7d3837d247e8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:01.170514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5b64739f-ccca-46b2-a12d-12da8caeb4b5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:01.170998 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c2aee010-97f4-40d9-a978-7d3837d247e8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:01.180546 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2aee010-97f4-40d9-a978-7d3837d247e8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:01.183472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2aee010-97f4-40d9-a978-7d3837d247e8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:01.184045 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5b64739f-ccca-46b2-a12d-12da8caeb4b5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1372 microversion: 2.1 time: 0.688684 Jul 11 14:16:01.184909 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2aee010-97f4-40d9-a978-7d3837d247e8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:01.185355 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2aee010-97f4-40d9-a978-7d3837d247e8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:01.186335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 155/295] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:00 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1372 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:01.193825 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-470aa3ff-4740-438a-9cbd-7be527a4fa95 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:01.194894 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-470aa3ff-4740-438a-9cbd-7be527a4fa95 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:01.209034 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-470aa3ff-4740-438a-9cbd-7be527a4fa95 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:01.209755 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-470aa3ff-4740-438a-9cbd-7be527a4fa95 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:01.210784 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-470aa3ff-4740-438a-9cbd-7be527a4fa95 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:01.211497 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-470aa3ff-4740-438a-9cbd-7be527a4fa95 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:01.321044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-470aa3ff-4740-438a-9cbd-7be527a4fa95 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:01.334885 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-470aa3ff-4740-438a-9cbd-7be527a4fa95 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1186 microversion: 2.1 time: 0.146423 Jul 11 14:16:01.336746 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 156/296] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:01 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1186 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:01.344245 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-073946ff-d3d7-44fe-9b4a-cfc660086b3b tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:01.344859 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-073946ff-d3d7-44fe-9b4a-cfc660086b3b tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:01.354195 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-073946ff-d3d7-44fe-9b4a-cfc660086b3b tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:01.354977 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-073946ff-d3d7-44fe-9b4a-cfc660086b3b tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:01.355380 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-073946ff-d3d7-44fe-9b4a-cfc660086b3b tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:01.356011 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-073946ff-d3d7-44fe-9b4a-cfc660086b3b tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:01.450221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c2aee010-97f4-40d9-a978-7d3837d247e8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:01.460753 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c2aee010-97f4-40d9-a978-7d3837d247e8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.296076 Jul 11 14:16:01.461804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 141/297] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:01 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:01.746826 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-073946ff-d3d7-44fe-9b4a-cfc660086b3b tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:01.769659 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-073946ff-d3d7-44fe-9b4a-cfc660086b3b tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 200 len: 1314 microversion: 2.1 time: 0.431314 Jul 11 14:16:01.773503 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 157/298] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:01 2022] GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:02.209709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8ee1cbcd-c325-42a9-b627-eda9c6e4743b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:02.211865 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8ee1cbcd-c325-42a9-b627-eda9c6e4743b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:02.242125 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ee1cbcd-c325-42a9-b627-eda9c6e4743b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:02.242940 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ee1cbcd-c325-42a9-b627-eda9c6e4743b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:02.244144 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ee1cbcd-c325-42a9-b627-eda9c6e4743b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:02.244918 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ee1cbcd-c325-42a9-b627-eda9c6e4743b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:02.275245 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:02.356168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3137737e-15e5-460c-a694-e1e567448ed4 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:02.357394 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3137737e-15e5-460c-a694-e1e567448ed4 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:02.364262 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3137737e-15e5-460c-a694-e1e567448ed4 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:02.365100 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3137737e-15e5-460c-a694-e1e567448ed4 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:02.366199 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3137737e-15e5-460c-a694-e1e567448ed4 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:02.367284 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3137737e-15e5-460c-a694-e1e567448ed4 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:02.504276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3137737e-15e5-460c-a694-e1e567448ed4 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:02.514613 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3137737e-15e5-460c-a694-e1e567448ed4 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1204 microversion: 2.1 time: 0.162280 Jul 11 14:16:02.526072 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 158/299] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:02 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1204 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:02.528239 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8ee1cbcd-c325-42a9-b627-eda9c6e4743b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:02.531017 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-19d59daa-7412-4781-b7a1-d9946d425fa3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:02.532066 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-19d59daa-7412-4781-b7a1-d9946d425fa3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:02.540220 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8ee1cbcd-c325-42a9-b627-eda9c6e4743b tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1372 microversion: 2.1 time: 0.340531 Jul 11 14:16:02.541161 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19d59daa-7412-4781-b7a1-d9946d425fa3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:02.541650 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19d59daa-7412-4781-b7a1-d9946d425fa3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:02.542876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19d59daa-7412-4781-b7a1-d9946d425fa3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:02.547612 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 142/300] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:02 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1372 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:02.548116 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19d59daa-7412-4781-b7a1-d9946d425fa3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:02.555225 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-4e0dfbeb-dc39-4f0e-8534-cdaa2dcf483b req-b6c5bb7f-352e-408f-95fc-ad640924f585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9baaee9-8fae-43c6-9194-4e0a6d56eee0", "tag": "74e4a1a7-efe0-4a24-9176-19987842b743"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:02.567561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4e0dfbeb-dc39-4f0e-8534-cdaa2dcf483b req-b6c5bb7f-352e-408f-95fc-ad640924f585 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:02.568082 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4e0dfbeb-dc39-4f0e-8534-cdaa2dcf483b req-b6c5bb7f-352e-408f-95fc-ad640924f585 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:02.586277 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-4e0dfbeb-dc39-4f0e-8534-cdaa2dcf483b req-b6c5bb7f-352e-408f-95fc-ad640924f585 service nova] Creating event network-changed:74e4a1a7-efe0-4a24-9176-19987842b743 for instance f9baaee9-8fae-43c6-9194-4e0a6d56eee0 on hv-cinder-81914 Jul 11 14:16:02.602422 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-4e0dfbeb-dc39-4f0e-8534-cdaa2dcf483b req-b6c5bb7f-352e-408f-95fc-ad640924f585 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052170 Jul 11 14:16:02.603376 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 143/301] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:02.795259 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-19d59daa-7412-4781-b7a1-d9946d425fa3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:02.801818 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-975a4e1e-9419-4afa-856b-b856133ed404 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:02.804337 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-975a4e1e-9419-4afa-856b-b856133ed404 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:02.805527 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-19d59daa-7412-4781-b7a1-d9946d425fa3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.278089 Jul 11 14:16:02.806525 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 159/302] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:02 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:02.828486 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-975a4e1e-9419-4afa-856b-b856133ed404 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:02.829035 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-975a4e1e-9419-4afa-856b-b856133ed404 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:02.829923 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-975a4e1e-9419-4afa-856b-b856133ed404 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:02.830467 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-975a4e1e-9419-4afa-856b-b856133ed404 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:03.111227 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-975a4e1e-9419-4afa-856b-b856133ed404 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:03.123710 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-975a4e1e-9419-4afa-856b-b856133ed404 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 200 len: 1314 microversion: 2.1 time: 0.337173 Jul 11 14:16:03.128056 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 144/303] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:02 2022] GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:16:03.533796 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-047966d1-184c-4f9f-91f0-c3f3b3d5e866 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:03.535315 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-047966d1-184c-4f9f-91f0-c3f3b3d5e866 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:03.543530 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-047966d1-184c-4f9f-91f0-c3f3b3d5e866 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:03.544272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-047966d1-184c-4f9f-91f0-c3f3b3d5e866 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:03.545447 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-047966d1-184c-4f9f-91f0-c3f3b3d5e866 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:03.546084 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-047966d1-184c-4f9f-91f0-c3f3b3d5e866 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:03.564581 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1cfe9b01-bd4f-4ecc-837a-c3494a2ef30e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:03.565308 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1cfe9b01-bd4f-4ecc-837a-c3494a2ef30e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:03.580119 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1cfe9b01-bd4f-4ecc-837a-c3494a2ef30e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:03.580675 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1cfe9b01-bd4f-4ecc-837a-c3494a2ef30e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:03.581497 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1cfe9b01-bd4f-4ecc-837a-c3494a2ef30e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:03.581935 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1cfe9b01-bd4f-4ecc-837a-c3494a2ef30e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:03.712949 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-047966d1-184c-4f9f-91f0-c3f3b3d5e866 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:03.728581 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-047966d1-184c-4f9f-91f0-c3f3b3d5e866 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1192 microversion: 2.1 time: 0.199203 Jul 11 14:16:03.730573 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 160/304] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:03 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1192 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:03.823702 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ce3f1832-8913-492b-91e0-80e7fa535b10 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:03.824498 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ce3f1832-8913-492b-91e0-80e7fa535b10 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:03.837579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce3f1832-8913-492b-91e0-80e7fa535b10 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:03.838149 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce3f1832-8913-492b-91e0-80e7fa535b10 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:03.839188 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce3f1832-8913-492b-91e0-80e7fa535b10 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:03.840326 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce3f1832-8913-492b-91e0-80e7fa535b10 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:03.870187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:03.989751 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1cfe9b01-bd4f-4ecc-837a-c3494a2ef30e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:04.002234 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1cfe9b01-bd4f-4ecc-837a-c3494a2ef30e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1372 microversion: 2.1 time: 0.441619 Jul 11 14:16:04.004578 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 145/305] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:03 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1372 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:04.145306 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-387d6cc8-767a-4d97-9ca6-680884299562 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:04.145922 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-387d6cc8-767a-4d97-9ca6-680884299562 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:04.154111 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-387d6cc8-767a-4d97-9ca6-680884299562 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:04.155018 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-387d6cc8-767a-4d97-9ca6-680884299562 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:04.156056 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-387d6cc8-767a-4d97-9ca6-680884299562 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:04.156669 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-387d6cc8-767a-4d97-9ca6-680884299562 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:04.174786 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ce3f1832-8913-492b-91e0-80e7fa535b10 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:04.190764 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ce3f1832-8913-492b-91e0-80e7fa535b10 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.370698 Jul 11 14:16:04.200092 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 161/306] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:03 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:16:04.426019 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-387d6cc8-767a-4d97-9ca6-680884299562 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:04.435847 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-387d6cc8-767a-4d97-9ca6-680884299562 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 200 len: 1314 microversion: 2.1 time: 0.294180 Jul 11 14:16:04.446816 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 146/307] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:04 2022] GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:04.746732 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-88911d45-ea3c-490f-af71-8e5c88a926d6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:04.747345 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-88911d45-ea3c-490f-af71-8e5c88a926d6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:04.754711 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88911d45-ea3c-490f-af71-8e5c88a926d6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:04.755191 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88911d45-ea3c-490f-af71-8e5c88a926d6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:04.755957 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88911d45-ea3c-490f-af71-8e5c88a926d6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:04.756384 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88911d45-ea3c-490f-af71-8e5c88a926d6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:04.895055 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-88911d45-ea3c-490f-af71-8e5c88a926d6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:04.903336 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-88911d45-ea3c-490f-af71-8e5c88a926d6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1259 microversion: 2.1 time: 0.160368 Jul 11 14:16:04.912323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 162/308] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:04 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:05.020422 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a19deacb-3133-4e90-bc98-3e1f766f4f94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:05.021018 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a19deacb-3133-4e90-bc98-3e1f766f4f94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:05.027652 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a19deacb-3133-4e90-bc98-3e1f766f4f94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:05.028093 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a19deacb-3133-4e90-bc98-3e1f766f4f94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:05.028848 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a19deacb-3133-4e90-bc98-3e1f766f4f94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:05.029282 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a19deacb-3133-4e90-bc98-3e1f766f4f94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:05.179864 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a19deacb-3133-4e90-bc98-3e1f766f4f94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:05.188760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a19deacb-3133-4e90-bc98-3e1f766f4f94 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1372 microversion: 2.1 time: 0.172076 Jul 11 14:16:05.189362 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 147/309] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:05 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:16:05.215003 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0112319b-58b4-4bfc-9b67-93e9b8a3d947 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:05.215672 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0112319b-58b4-4bfc-9b67-93e9b8a3d947 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:05.222657 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0112319b-58b4-4bfc-9b67-93e9b8a3d947 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:05.223112 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0112319b-58b4-4bfc-9b67-93e9b8a3d947 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:05.223897 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0112319b-58b4-4bfc-9b67-93e9b8a3d947 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:05.224421 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0112319b-58b4-4bfc-9b67-93e9b8a3d947 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:05.454297 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-eb242411-997f-4593-80ec-4e1334dce9fc tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:05.455460 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-eb242411-997f-4593-80ec-4e1334dce9fc tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:05.461584 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb242411-997f-4593-80ec-4e1334dce9fc tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:05.462141 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb242411-997f-4593-80ec-4e1334dce9fc tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:05.463029 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb242411-997f-4593-80ec-4e1334dce9fc tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:05.463531 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb242411-997f-4593-80ec-4e1334dce9fc tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:05.464881 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0112319b-58b4-4bfc-9b67-93e9b8a3d947 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:05.474242 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0112319b-58b4-4bfc-9b67-93e9b8a3d947 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.263139 Jul 11 14:16:05.474839 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 163/310] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:05 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:05.619364 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-eb242411-997f-4593-80ec-4e1334dce9fc tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:05.629248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-eb242411-997f-4593-80ec-4e1334dce9fc tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 200 len: 1314 microversion: 2.1 time: 0.179519 Jul 11 14:16:05.629907 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 148/311] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:05 2022] GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:16:05.921059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b12ca49a-b84c-41bb-a9ce-412be122f1f5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:05.921980 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b12ca49a-b84c-41bb-a9ce-412be122f1f5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:05.928876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b12ca49a-b84c-41bb-a9ce-412be122f1f5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:05.929319 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b12ca49a-b84c-41bb-a9ce-412be122f1f5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:05.930089 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b12ca49a-b84c-41bb-a9ce-412be122f1f5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:05.930556 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b12ca49a-b84c-41bb-a9ce-412be122f1f5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:06.013340 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-3c8623ff-3185-42b4-802c-047aea88d882 req-857131af-2e46-4a9c-934e-42944b74744d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374e3321-9408-4c7b-b2c3-8be5d7ed6561", "tag": "6d373871-6631-4afb-9527-c160464851a2"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:06.026447 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-3c8623ff-3185-42b4-802c-047aea88d882 req-857131af-2e46-4a9c-934e-42944b74744d service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:06.027120 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-3c8623ff-3185-42b4-802c-047aea88d882 req-857131af-2e46-4a9c-934e-42944b74744d service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:06.039520 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-3c8623ff-3185-42b4-802c-047aea88d882 req-857131af-2e46-4a9c-934e-42944b74744d service nova] Creating event network-changed:6d373871-6631-4afb-9527-c160464851a2 for instance 374e3321-9408-4c7b-b2c3-8be5d7ed6561 on hv-cinder-81914 Jul 11 14:16:06.050943 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-3c8623ff-3185-42b4-802c-047aea88d882 req-857131af-2e46-4a9c-934e-42944b74744d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041141 Jul 11 14:16:06.051560 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 149/312] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:16:06.170228 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b12ca49a-b84c-41bb-a9ce-412be122f1f5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:06.182391 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b12ca49a-b84c-41bb-a9ce-412be122f1f5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1259 microversion: 2.1 time: 0.265108 Jul 11 14:16:06.183597 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 164/313] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:05 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1259 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:06.206653 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-07b097b2-f69b-456c-b382-d7dc052dc761 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:06.207631 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-07b097b2-f69b-456c-b382-d7dc052dc761 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:06.222012 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-07b097b2-f69b-456c-b382-d7dc052dc761 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:06.222785 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-07b097b2-f69b-456c-b382-d7dc052dc761 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:06.223774 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-07b097b2-f69b-456c-b382-d7dc052dc761 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:06.224211 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-07b097b2-f69b-456c-b382-d7dc052dc761 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:06.321972 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-91148844-6422-421e-bfbb-4a23665ee109 req-6b1e52b6-a577-4f97-96af-bcc744750e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413449f2-c97f-4bb8-a3c8-e8447fe3d1a8", "name": "network-vif-plugged", "status": "completed", "tag": "8bfd8a36-2339-4c5c-9836-b9d0b3694f20"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:06.360311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-91148844-6422-421e-bfbb-4a23665ee109 req-6b1e52b6-a577-4f97-96af-bcc744750e42 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:06.361192 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-91148844-6422-421e-bfbb-4a23665ee109 req-6b1e52b6-a577-4f97-96af-bcc744750e42 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:06.373457 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-91148844-6422-421e-bfbb-4a23665ee109 req-6b1e52b6-a577-4f97-96af-bcc744750e42 service nova] Creating event network-vif-plugged:8bfd8a36-2339-4c5c-9836-b9d0b3694f20 for instance 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 on hv-cinder-81914 Jul 11 14:16:06.376655 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-07b097b2-f69b-456c-b382-d7dc052dc761 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:06.382626 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-91148844-6422-421e-bfbb-4a23665ee109 req-6b1e52b6-a577-4f97-96af-bcc744750e42 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065480 Jul 11 14:16:06.384567 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 165/314] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:16:06.386275 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-07b097b2-f69b-456c-b382-d7dc052dc761 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1372 microversion: 2.1 time: 0.184956 Jul 11 14:16:06.390861 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 150/315] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:06 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:06.491904 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-faa4d877-5c1d-4661-bac3-773d17e7d62e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:06.492872 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-faa4d877-5c1d-4661-bac3-773d17e7d62e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:06.499479 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-faa4d877-5c1d-4661-bac3-773d17e7d62e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:06.500008 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-faa4d877-5c1d-4661-bac3-773d17e7d62e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:06.500791 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-faa4d877-5c1d-4661-bac3-773d17e7d62e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:06.501397 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-faa4d877-5c1d-4661-bac3-773d17e7d62e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:06.647462 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-56e05f80-d152-47ae-9953-a5c97d589d40 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:06.648218 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-56e05f80-d152-47ae-9953-a5c97d589d40 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:06.656825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-56e05f80-d152-47ae-9953-a5c97d589d40 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:06.657541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-56e05f80-d152-47ae-9953-a5c97d589d40 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:06.658369 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-56e05f80-d152-47ae-9953-a5c97d589d40 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:06.658804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-56e05f80-d152-47ae-9953-a5c97d589d40 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:06.685944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-faa4d877-5c1d-4661-bac3-773d17e7d62e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:06.694342 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-faa4d877-5c1d-4661-bac3-773d17e7d62e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.206637 Jul 11 14:16:06.694931 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 166/316] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:06 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:06.801440 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-56e05f80-d152-47ae-9953-a5c97d589d40 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:06.809189 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-56e05f80-d152-47ae-9953-a5c97d589d40 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 200 len: 1314 microversion: 2.1 time: 0.165809 Jul 11 14:16:06.809691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 151/317] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:06 2022] GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:07.199731 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c18e885e-5e9c-4c64-98dc-1f77e76fc66f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:07.200358 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c18e885e-5e9c-4c64-98dc-1f77e76fc66f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:07.207807 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c18e885e-5e9c-4c64-98dc-1f77e76fc66f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:07.208257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c18e885e-5e9c-4c64-98dc-1f77e76fc66f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:07.209033 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c18e885e-5e9c-4c64-98dc-1f77e76fc66f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:07.209476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c18e885e-5e9c-4c64-98dc-1f77e76fc66f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:07.343638 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c18e885e-5e9c-4c64-98dc-1f77e76fc66f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:07.352263 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c18e885e-5e9c-4c64-98dc-1f77e76fc66f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1259 microversion: 2.1 time: 0.156261 Jul 11 14:16:07.352908 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 167/318] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:07 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:07.403458 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-378287eb-6abc-432e-8c2f-7c6237d4a655 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:07.404058 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-378287eb-6abc-432e-8c2f-7c6237d4a655 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:07.410539 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-378287eb-6abc-432e-8c2f-7c6237d4a655 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:07.410984 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-378287eb-6abc-432e-8c2f-7c6237d4a655 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:07.411795 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-378287eb-6abc-432e-8c2f-7c6237d4a655 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:07.412223 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-378287eb-6abc-432e-8c2f-7c6237d4a655 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:07.553375 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-378287eb-6abc-432e-8c2f-7c6237d4a655 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:07.561092 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-378287eb-6abc-432e-8c2f-7c6237d4a655 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1372 microversion: 2.1 time: 0.161505 Jul 11 14:16:07.561668 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 152/319] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:07 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:07.713085 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ce3065dc-d736-4107-97c7-ed2d6226d51f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:07.713624 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ce3065dc-d736-4107-97c7-ed2d6226d51f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:07.720650 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce3065dc-d736-4107-97c7-ed2d6226d51f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:07.721105 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce3065dc-d736-4107-97c7-ed2d6226d51f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:07.721878 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce3065dc-d736-4107-97c7-ed2d6226d51f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:07.722365 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce3065dc-d736-4107-97c7-ed2d6226d51f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:07.794488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:07.825147 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-dc645ecb-a1e5-4773-87ae-0ff58467c94d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:07.826264 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-dc645ecb-a1e5-4773-87ae-0ff58467c94d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:07.833757 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dc645ecb-a1e5-4773-87ae-0ff58467c94d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:07.834070 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dc645ecb-a1e5-4773-87ae-0ff58467c94d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:07.834885 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dc645ecb-a1e5-4773-87ae-0ff58467c94d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:07.835400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dc645ecb-a1e5-4773-87ae-0ff58467c94d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:07.869517 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ce3065dc-d736-4107-97c7-ed2d6226d51f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:07.878423 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ce3065dc-d736-4107-97c7-ed2d6226d51f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1723 microversion: 2.1 time: 0.169256 Jul 11 14:16:07.886216 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 168/320] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:07 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:07.976068 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-dc645ecb-a1e5-4773-87ae-0ff58467c94d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:07.983492 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-dc645ecb-a1e5-4773-87ae-0ff58467c94d tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 200 len: 1314 microversion: 2.1 time: 0.162443 Jul 11 14:16:07.984090 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 153/321] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:07 2022] GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:16:08.372393 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ad698eaf-74c8-49b6-986f-73fe6c2354ad tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:08.373049 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ad698eaf-74c8-49b6-986f-73fe6c2354ad tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:08.380913 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad698eaf-74c8-49b6-986f-73fe6c2354ad tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:08.381434 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad698eaf-74c8-49b6-986f-73fe6c2354ad tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:08.382130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad698eaf-74c8-49b6-986f-73fe6c2354ad tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:08.382592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad698eaf-74c8-49b6-986f-73fe6c2354ad tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:08.517130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ad698eaf-74c8-49b6-986f-73fe6c2354ad tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:08.524704 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ad698eaf-74c8-49b6-986f-73fe6c2354ad tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1259 microversion: 2.1 time: 0.156573 Jul 11 14:16:08.525277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 169/322] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:08 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:08.578881 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-827a6fbb-3fb7-4f9e-b9b8-af4076ca8d77 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:08.579486 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-827a6fbb-3fb7-4f9e-b9b8-af4076ca8d77 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:08.586032 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-827a6fbb-3fb7-4f9e-b9b8-af4076ca8d77 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:08.586522 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-827a6fbb-3fb7-4f9e-b9b8-af4076ca8d77 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:08.587292 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-827a6fbb-3fb7-4f9e-b9b8-af4076ca8d77 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:08.587721 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-827a6fbb-3fb7-4f9e-b9b8-af4076ca8d77 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:08.745351 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-827a6fbb-3fb7-4f9e-b9b8-af4076ca8d77 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:08.753531 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-827a6fbb-3fb7-4f9e-b9b8-af4076ca8d77 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1372 microversion: 2.1 time: 0.178669 Jul 11 14:16:08.755208 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 154/323] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:08 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:08.897277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-65a31979-1fbf-4624-903d-22fbd8673974 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:08.897926 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-65a31979-1fbf-4624-903d-22fbd8673974 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:08.905018 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65a31979-1fbf-4624-903d-22fbd8673974 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:08.906174 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65a31979-1fbf-4624-903d-22fbd8673974 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:08.907524 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65a31979-1fbf-4624-903d-22fbd8673974 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:08.908180 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65a31979-1fbf-4624-903d-22fbd8673974 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:09.000390 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-31f1ee72-2fa6-4e5b-b1f6-22019a7cf928 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:09.001117 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-31f1ee72-2fa6-4e5b-b1f6-22019a7cf928 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:09.007587 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-31f1ee72-2fa6-4e5b-b1f6-22019a7cf928 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:09.008043 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-31f1ee72-2fa6-4e5b-b1f6-22019a7cf928 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:09.008823 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-31f1ee72-2fa6-4e5b-b1f6-22019a7cf928 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:09.009259 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-31f1ee72-2fa6-4e5b-b1f6-22019a7cf928 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:09.044727 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-65a31979-1fbf-4624-903d-22fbd8673974 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:09.053811 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-65a31979-1fbf-4624-903d-22fbd8673974 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1700 microversion: 2.1 time: 0.160579 Jul 11 14:16:09.054444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 170/324] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:08 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1700 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:09.070243 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-191f6b7b-28b6-4c9a-af21-6eaf0c820792 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:09.076304 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-191f6b7b-28b6-4c9a-af21-6eaf0c820792 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:09.076784 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-191f6b7b-28b6-4c9a-af21-6eaf0c820792 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:09.140369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-191f6b7b-28b6-4c9a-af21-6eaf0c820792 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Going to try to start instance {{(pid=117920) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 11 14:16:09.144360 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-31f1ee72-2fa6-4e5b-b1f6-22019a7cf928 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:09.152376 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-31f1ee72-2fa6-4e5b-b1f6-22019a7cf928 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 200 len: 1314 microversion: 2.1 time: 0.156418 Jul 11 14:16:09.152945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 155/325] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:08 2022] GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:16:09.186151 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-191f6b7b-28b6-4c9a-af21-6eaf0c820792 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "POST /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27/action" status: 202 len: 0 microversion: 2.1 time: 0.119446 Jul 11 14:16:09.188060 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 171/326] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 11 14:16:09 2022] POST /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 14:16:09.196169 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1a25a5a9-853d-431d-811f-c45b0e97cd7a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:09.197521 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1a25a5a9-853d-431d-811f-c45b0e97cd7a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:09.204867 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1a25a5a9-853d-431d-811f-c45b0e97cd7a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:09.205315 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1a25a5a9-853d-431d-811f-c45b0e97cd7a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:09.206093 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1a25a5a9-853d-431d-811f-c45b0e97cd7a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:09.206585 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1a25a5a9-853d-431d-811f-c45b0e97cd7a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:09.348717 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1a25a5a9-853d-431d-811f-c45b0e97cd7a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:09.357425 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1a25a5a9-853d-431d-811f-c45b0e97cd7a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1709 microversion: 2.1 time: 0.165224 Jul 11 14:16:09.358005 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 156/327] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:09 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:09.544257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-30ed9ebb-e82e-4cc4-af4d-a1c99bfcbfae tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:09.547004 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-30ed9ebb-e82e-4cc4-af4d-a1c99bfcbfae tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:09.553939 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30ed9ebb-e82e-4cc4-af4d-a1c99bfcbfae tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:09.554430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30ed9ebb-e82e-4cc4-af4d-a1c99bfcbfae tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:09.555283 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30ed9ebb-e82e-4cc4-af4d-a1c99bfcbfae tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:09.555722 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30ed9ebb-e82e-4cc4-af4d-a1c99bfcbfae tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:09.745730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-30ed9ebb-e82e-4cc4-af4d-a1c99bfcbfae tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:09.754143 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-30ed9ebb-e82e-4cc4-af4d-a1c99bfcbfae tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1259 microversion: 2.1 time: 0.215170 Jul 11 14:16:09.754979 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 172/328] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:09 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:09.771548 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-99f0eab0-de6c-4857-9d7d-5e6c77fa814a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:09.772830 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-99f0eab0-de6c-4857-9d7d-5e6c77fa814a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:09.775945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:09.781251 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99f0eab0-de6c-4857-9d7d-5e6c77fa814a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:09.781706 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99f0eab0-de6c-4857-9d7d-5e6c77fa814a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:09.782537 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99f0eab0-de6c-4857-9d7d-5e6c77fa814a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:09.782977 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99f0eab0-de6c-4857-9d7d-5e6c77fa814a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:09.922866 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-99f0eab0-de6c-4857-9d7d-5e6c77fa814a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:09.932211 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-99f0eab0-de6c-4857-9d7d-5e6c77fa814a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1566 microversion: 2.1 time: 0.164197 Jul 11 14:16:09.942515 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 157/329] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:09 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:09.950458 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-20355d5c-f16a-4b48-8c92-96919a1b63d8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:09.951080 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-20355d5c-f16a-4b48-8c92-96919a1b63d8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:09.953835 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=22 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:09.959232 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-20355d5c-f16a-4b48-8c92-96919a1b63d8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:09.959693 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-20355d5c-f16a-4b48-8c92-96919a1b63d8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:09.960459 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-20355d5c-f16a-4b48-8c92-96919a1b63d8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:09.960894 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-20355d5c-f16a-4b48-8c92-96919a1b63d8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:10.062413 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-20355d5c-f16a-4b48-8c92-96919a1b63d8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114968 Jul 11 14:16:10.063369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 173/330] 10.222.0.66 () {58 vars in 1274 bytes} [Mon Jul 11 14:16:09 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:10.170466 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e2051c60-6c68-4aa6-bc3b-926e89830d63 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:10.171131 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e2051c60-6c68-4aa6-bc3b-926e89830d63 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:10.177537 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e2051c60-6c68-4aa6-bc3b-926e89830d63 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:10.177993 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e2051c60-6c68-4aa6-bc3b-926e89830d63 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:10.178858 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e2051c60-6c68-4aa6-bc3b-926e89830d63 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:10.179298 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e2051c60-6c68-4aa6-bc3b-926e89830d63 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:10.376514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-95570b91-90e4-420d-9099-5e2d1a437b04 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:10.377308 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-95570b91-90e4-420d-9099-5e2d1a437b04 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:10.384670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95570b91-90e4-420d-9099-5e2d1a437b04 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:10.385543 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95570b91-90e4-420d-9099-5e2d1a437b04 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:10.386639 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95570b91-90e4-420d-9099-5e2d1a437b04 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:10.387309 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95570b91-90e4-420d-9099-5e2d1a437b04 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:10.500342 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e2051c60-6c68-4aa6-bc3b-926e89830d63 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:10.511281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e2051c60-6c68-4aa6-bc3b-926e89830d63 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 200 len: 1314 microversion: 2.1 time: 0.344768 Jul 11 14:16:10.511823 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 158/331] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:10 2022] GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:10.518935 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-51fb99ef-7327-403b-b4a3-bfdf56aa9ac8 req-10420fd3-f6f8-42c2-954b-d2f8b73bf816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9baaee9-8fae-43c6-9194-4e0a6d56eee0", "name": "network-vif-plugged", "status": "completed", "tag": "74e4a1a7-efe0-4a24-9176-19987842b743"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:10.529076 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-51fb99ef-7327-403b-b4a3-bfdf56aa9ac8 req-10420fd3-f6f8-42c2-954b-d2f8b73bf816 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:10.529946 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-51fb99ef-7327-403b-b4a3-bfdf56aa9ac8 req-10420fd3-f6f8-42c2-954b-d2f8b73bf816 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:10.542905 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-51fb99ef-7327-403b-b4a3-bfdf56aa9ac8 req-10420fd3-f6f8-42c2-954b-d2f8b73bf816 service nova] Creating event network-vif-plugged:74e4a1a7-efe0-4a24-9176-19987842b743 for instance f9baaee9-8fae-43c6-9194-4e0a6d56eee0 on hv-cinder-81914 Jul 11 14:16:10.553530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-51fb99ef-7327-403b-b4a3-bfdf56aa9ac8 req-10420fd3-f6f8-42c2-954b-d2f8b73bf816 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039492 Jul 11 14:16:10.554550 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 159/332] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:10.584311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-95570b91-90e4-420d-9099-5e2d1a437b04 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:10.593910 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-95570b91-90e4-420d-9099-5e2d1a437b04 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1709 microversion: 2.1 time: 0.222368 Jul 11 14:16:10.594737 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 174/333] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:10 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1709 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:16:10.771848 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9e28056d-17f0-48d3-b1d8-01cba7d6811e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:10.772578 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9e28056d-17f0-48d3-b1d8-01cba7d6811e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:10.779758 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e28056d-17f0-48d3-b1d8-01cba7d6811e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:10.780206 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e28056d-17f0-48d3-b1d8-01cba7d6811e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:10.781568 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e28056d-17f0-48d3-b1d8-01cba7d6811e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:10.782010 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e28056d-17f0-48d3-b1d8-01cba7d6811e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:11.056222 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9e28056d-17f0-48d3-b1d8-01cba7d6811e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:11.067993 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9e28056d-17f0-48d3-b1d8-01cba7d6811e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1259 microversion: 2.1 time: 0.300189 Jul 11 14:16:11.068598 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 160/334] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:10 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1259 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:11.528542 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-643b147b-4b6d-4761-afd1-ccb4f9df0179 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:11.529075 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-643b147b-4b6d-4761-afd1-ccb4f9df0179 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:11.535874 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-643b147b-4b6d-4761-afd1-ccb4f9df0179 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:11.536344 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-643b147b-4b6d-4761-afd1-ccb4f9df0179 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:11.537308 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-643b147b-4b6d-4761-afd1-ccb4f9df0179 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:11.537741 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-643b147b-4b6d-4761-afd1-ccb4f9df0179 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:11.601285 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-55fa8cab-629d-47f5-ad5b-ca3ad8ac0710 req-23515f1d-0492-4300-b624-0e28db94bfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "413449f2-c97f-4bb8-a3c8-e8447fe3d1a8", "tag": "8bfd8a36-2339-4c5c-9836-b9d0b3694f20"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:11.621110 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=10 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:11.624743 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-55fa8cab-629d-47f5-ad5b-ca3ad8ac0710 req-23515f1d-0492-4300-b624-0e28db94bfa4 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:11.625176 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-55fa8cab-629d-47f5-ad5b-ca3ad8ac0710 req-23515f1d-0492-4300-b624-0e28db94bfa4 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:11.630444 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:11.644473 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-55fa8cab-629d-47f5-ad5b-ca3ad8ac0710 req-23515f1d-0492-4300-b624-0e28db94bfa4 service nova] Creating event network-changed:8bfd8a36-2339-4c5c-9836-b9d0b3694f20 for instance 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 on hv-cinder-81914 Jul 11 14:16:11.649901 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-55fa8cab-629d-47f5-ad5b-ca3ad8ac0710 req-23515f1d-0492-4300-b624-0e28db94bfa4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052137 Jul 11 14:16:11.651765 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 161/335] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:16:11.661746 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-92d31459-62e6-43f2-8740-10c60c6dd060 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:11.662497 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-92d31459-62e6-43f2-8740-10c60c6dd060 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:11.671935 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:11.674105 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-92d31459-62e6-43f2-8740-10c60c6dd060 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:11.675872 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-92d31459-62e6-43f2-8740-10c60c6dd060 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:11.675872 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-92d31459-62e6-43f2-8740-10c60c6dd060 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:11.676286 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-92d31459-62e6-43f2-8740-10c60c6dd060 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:11.738389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-643b147b-4b6d-4761-afd1-ccb4f9df0179 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:11.747237 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-643b147b-4b6d-4761-afd1-ccb4f9df0179 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 200 len: 1314 microversion: 2.1 time: 0.222589 Jul 11 14:16:11.748248 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 175/336] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:11 2022] GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:11.818139 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-92d31459-62e6-43f2-8740-10c60c6dd060 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:11.826640 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-92d31459-62e6-43f2-8740-10c60c6dd060 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1713 microversion: 2.1 time: 0.172220 Jul 11 14:16:11.827249 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 162/337] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:11 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1713 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:12.084961 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a66b3a0b-5e13-4618-82f1-38bf6fd10e67 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:12.085499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a66b3a0b-5e13-4618-82f1-38bf6fd10e67 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:12.097440 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a66b3a0b-5e13-4618-82f1-38bf6fd10e67 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:12.097895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a66b3a0b-5e13-4618-82f1-38bf6fd10e67 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:12.098771 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a66b3a0b-5e13-4618-82f1-38bf6fd10e67 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:12.099247 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a66b3a0b-5e13-4618-82f1-38bf6fd10e67 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:12.245231 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a66b3a0b-5e13-4618-82f1-38bf6fd10e67 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:12.253461 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a66b3a0b-5e13-4618-82f1-38bf6fd10e67 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1259 microversion: 2.1 time: 0.172404 Jul 11 14:16:12.254426 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 176/338] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:12 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:12.635073 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-c784d440-89d8-4dff-a3ec-562ec4b3ec3a req-130d505a-25c9-4b89-ad94-e9695b0d60d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374e3321-9408-4c7b-b2c3-8be5d7ed6561", "name": "network-vif-plugged", "status": "completed", "tag": "6d373871-6631-4afb-9527-c160464851a2"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:12.643824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-c784d440-89d8-4dff-a3ec-562ec4b3ec3a req-130d505a-25c9-4b89-ad94-e9695b0d60d8 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:12.644266 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-c784d440-89d8-4dff-a3ec-562ec4b3ec3a req-130d505a-25c9-4b89-ad94-e9695b0d60d8 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:12.659035 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-c784d440-89d8-4dff-a3ec-562ec4b3ec3a req-130d505a-25c9-4b89-ad94-e9695b0d60d8 service nova] Creating event network-vif-plugged:6d373871-6631-4afb-9527-c160464851a2 for instance 374e3321-9408-4c7b-b2c3-8be5d7ed6561 on hv-cinder-81914 Jul 11 14:16:12.664296 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-c784d440-89d8-4dff-a3ec-562ec4b3ec3a req-130d505a-25c9-4b89-ad94-e9695b0d60d8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032823 Jul 11 14:16:12.665543 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 163/339] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:16:12.766992 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-81ae47bf-9a98-433b-8a84-b9c96a00c9f1 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:12.766992 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-81ae47bf-9a98-433b-8a84-b9c96a00c9f1 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:12.775033 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-81ae47bf-9a98-433b-8a84-b9c96a00c9f1 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:12.775797 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-81ae47bf-9a98-433b-8a84-b9c96a00c9f1 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:12.776766 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-81ae47bf-9a98-433b-8a84-b9c96a00c9f1 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:12.777188 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-81ae47bf-9a98-433b-8a84-b9c96a00c9f1 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:12.961541 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-81ae47bf-9a98-433b-8a84-b9c96a00c9f1 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:12.963862 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:12.973029 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-81ae47bf-9a98-433b-8a84-b9c96a00c9f1 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 200 len: 1314 microversion: 2.1 time: 0.211689 Jul 11 14:16:12.974235 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 177/340] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:12 2022] GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:13.272794 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-50de5f46-0193-4bda-9379-c99d2808ff3e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:13.273500 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-50de5f46-0193-4bda-9379-c99d2808ff3e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:13.280129 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50de5f46-0193-4bda-9379-c99d2808ff3e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:13.280629 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50de5f46-0193-4bda-9379-c99d2808ff3e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:13.281708 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50de5f46-0193-4bda-9379-c99d2808ff3e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:13.282141 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50de5f46-0193-4bda-9379-c99d2808ff3e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:13.424769 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-50de5f46-0193-4bda-9379-c99d2808ff3e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:13.432585 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-50de5f46-0193-4bda-9379-c99d2808ff3e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1259 microversion: 2.1 time: 0.164418 Jul 11 14:16:13.433197 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 164/341] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:13 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:13.990341 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1a4989a1-e29c-4c3f-a3f3-31f6d96b8419 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:13.990962 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1a4989a1-e29c-4c3f-a3f3-31f6d96b8419 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:13.998173 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a4989a1-e29c-4c3f-a3f3-31f6d96b8419 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:14.000431 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a4989a1-e29c-4c3f-a3f3-31f6d96b8419 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:14.001826 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a4989a1-e29c-4c3f-a3f3-31f6d96b8419 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:14.002312 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a4989a1-e29c-4c3f-a3f3-31f6d96b8419 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:14.152877 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1a4989a1-e29c-4c3f-a3f3-31f6d96b8419 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:14.161021 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1a4989a1-e29c-4c3f-a3f3-31f6d96b8419 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 200 len: 1498 microversion: 2.1 time: 0.175212 Jul 11 14:16:14.161593 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 178/342] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:13 2022] GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 1498 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:14.449969 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-caa84ec6-b5c8-4ef3-b204-dcc3e24534b5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:14.451357 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-caa84ec6-b5c8-4ef3-b204-dcc3e24534b5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:14.460889 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-caa84ec6-b5c8-4ef3-b204-dcc3e24534b5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:14.461612 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-caa84ec6-b5c8-4ef3-b204-dcc3e24534b5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:14.462619 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-caa84ec6-b5c8-4ef3-b204-dcc3e24534b5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:14.463211 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-caa84ec6-b5c8-4ef3-b204-dcc3e24534b5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:14.614536 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-caa84ec6-b5c8-4ef3-b204-dcc3e24534b5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:14.621986 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-caa84ec6-b5c8-4ef3-b204-dcc3e24534b5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1259 microversion: 2.1 time: 0.176307 Jul 11 14:16:14.622593 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 165/343] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:14 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:14.808930 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4361728c-80ad-4959-848b-8ae2864ab2bf tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:14.809428 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4361728c-80ad-4959-848b-8ae2864ab2bf tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:14.817134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4361728c-80ad-4959-848b-8ae2864ab2bf tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:14.817582 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4361728c-80ad-4959-848b-8ae2864ab2bf tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:14.818568 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4361728c-80ad-4959-848b-8ae2864ab2bf tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:14.819004 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4361728c-80ad-4959-848b-8ae2864ab2bf tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:14.846991 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4361728c-80ad-4959-848b-8ae2864ab2bf tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:16:14.935810 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:14.954360 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4361728c-80ad-4959-848b-8ae2864ab2bf tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 204 len: 0 microversion: 2.1 time: 0.149705 Jul 11 14:16:14.955025 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 179/344] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:16:14 2022] DELETE /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:16:14.963127 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f53e1f3b-c78f-42ba-9142-4c548d3dee7c tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:14.963745 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f53e1f3b-c78f-42ba-9142-4c548d3dee7c tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:14.970742 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f53e1f3b-c78f-42ba-9142-4c548d3dee7c tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:14.971197 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f53e1f3b-c78f-42ba-9142-4c548d3dee7c tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:14.971963 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f53e1f3b-c78f-42ba-9142-4c548d3dee7c tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:14.972401 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f53e1f3b-c78f-42ba-9142-4c548d3dee7c tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:15.123328 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f53e1f3b-c78f-42ba-9142-4c548d3dee7c tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:15.131518 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f53e1f3b-c78f-42ba-9142-4c548d3dee7c tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 200 len: 1504 microversion: 2.1 time: 0.172102 Jul 11 14:16:15.132460 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 166/345] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:14 2022] GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:15.639739 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0c971a1f-0d3e-4e2e-8a2c-f7917d3f7f30 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:15.640528 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0c971a1f-0d3e-4e2e-8a2c-f7917d3f7f30 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:15.647025 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c971a1f-0d3e-4e2e-8a2c-f7917d3f7f30 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:15.647474 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c971a1f-0d3e-4e2e-8a2c-f7917d3f7f30 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:15.648247 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c971a1f-0d3e-4e2e-8a2c-f7917d3f7f30 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:15.648681 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c971a1f-0d3e-4e2e-8a2c-f7917d3f7f30 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:15.784946 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c971a1f-0d3e-4e2e-8a2c-f7917d3f7f30 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:15.792470 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0c971a1f-0d3e-4e2e-8a2c-f7917d3f7f30 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1259 microversion: 2.1 time: 0.156979 Jul 11 14:16:15.793045 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 180/346] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:15 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:16.149542 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5f24cfb9-6443-47b5-b471-f9ac97b78668 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:16.150247 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5f24cfb9-6443-47b5-b471-f9ac97b78668 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:16.157847 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f24cfb9-6443-47b5-b471-f9ac97b78668 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:16.158332 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f24cfb9-6443-47b5-b471-f9ac97b78668 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:16.159101 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f24cfb9-6443-47b5-b471-f9ac97b78668 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:16.159531 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f24cfb9-6443-47b5-b471-f9ac97b78668 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:16.304302 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5f24cfb9-6443-47b5-b471-f9ac97b78668 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:16.311921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5f24cfb9-6443-47b5-b471-f9ac97b78668 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 200 len: 1504 microversion: 2.1 time: 0.166047 Jul 11 14:16:16.312620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 167/347] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:16 2022] GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:16.808861 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d1237946-ebd4-4d9d-a32e-6629454ce316 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:16.809400 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d1237946-ebd4-4d9d-a32e-6629454ce316 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:16.816479 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d1237946-ebd4-4d9d-a32e-6629454ce316 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:16.816930 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d1237946-ebd4-4d9d-a32e-6629454ce316 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:16.817683 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d1237946-ebd4-4d9d-a32e-6629454ce316 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:16.818110 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d1237946-ebd4-4d9d-a32e-6629454ce316 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:16.953804 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d1237946-ebd4-4d9d-a32e-6629454ce316 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:16.961435 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d1237946-ebd4-4d9d-a32e-6629454ce316 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1443 microversion: 2.1 time: 0.156526 Jul 11 14:16:16.962010 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 181/348] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:16 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:16.978038 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e4db56ec-8287-40a7-bc39-2244e6fd0cce tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:16.978689 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e4db56ec-8287-40a7-bc39-2244e6fd0cce tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:16.985411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e4db56ec-8287-40a7-bc39-2244e6fd0cce tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:16.985848 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e4db56ec-8287-40a7-bc39-2244e6fd0cce tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:16.986652 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e4db56ec-8287-40a7-bc39-2244e6fd0cce tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:16.987088 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e4db56ec-8287-40a7-bc39-2244e6fd0cce tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:17.131658 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e4db56ec-8287-40a7-bc39-2244e6fd0cce tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:17.139174 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e4db56ec-8287-40a7-bc39-2244e6fd0cce tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1443 microversion: 2.1 time: 0.164996 Jul 11 14:16:17.139790 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 168/349] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:16 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:17.328830 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3a8f5bd5-177c-4615-b04b-5679ef691e60 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:17.329452 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3a8f5bd5-177c-4615-b04b-5679ef691e60 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:17.335696 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a8f5bd5-177c-4615-b04b-5679ef691e60 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:17.336114 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a8f5bd5-177c-4615-b04b-5679ef691e60 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:17.336890 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a8f5bd5-177c-4615-b04b-5679ef691e60 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:17.337323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a8f5bd5-177c-4615-b04b-5679ef691e60 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:17.475422 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3a8f5bd5-177c-4615-b04b-5679ef691e60 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:17.484040 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3a8f5bd5-177c-4615-b04b-5679ef691e60 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 200 len: 1504 microversion: 2.1 time: 0.158546 Jul 11 14:16:17.484733 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 182/350] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:17 2022] GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:18.501891 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0828a9eb-320d-47b9-850f-6badde6bc068 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:18.502561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0828a9eb-320d-47b9-850f-6badde6bc068 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:18.509648 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0828a9eb-320d-47b9-850f-6badde6bc068 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:18.510097 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0828a9eb-320d-47b9-850f-6badde6bc068 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:18.510932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0828a9eb-320d-47b9-850f-6badde6bc068 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:18.511368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0828a9eb-320d-47b9-850f-6badde6bc068 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:18.596775 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0828a9eb-320d-47b9-850f-6badde6bc068 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2b65c48bc141abbd3c56b791b213ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc81783ff1f4a47b617e77618303f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:18.604892 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0828a9eb-320d-47b9-850f-6badde6bc068 tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 200 len: 1462 microversion: 2.1 time: 0.107485 Jul 11 14:16:18.605476 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 169/351] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:18 2022] GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 1462 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:18.692492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-c6ab1fa3-53c7-4213-86e8-453a81435c9c req-bff5b441-0f05-4e59-8bf7-81ed77e99b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9baaee9-8fae-43c6-9194-4e0a6d56eee0", "name": "network-vif-deleted", "tag": "74e4a1a7-efe0-4a24-9176-19987842b743"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:18.703041 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c6ab1fa3-53c7-4213-86e8-453a81435c9c req-bff5b441-0f05-4e59-8bf7-81ed77e99b67 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:18.703552 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c6ab1fa3-53c7-4213-86e8-453a81435c9c req-bff5b441-0f05-4e59-8bf7-81ed77e99b67 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:18.716269 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-c6ab1fa3-53c7-4213-86e8-453a81435c9c req-bff5b441-0f05-4e59-8bf7-81ed77e99b67 service nova] Creating event network-vif-deleted:74e4a1a7-efe0-4a24-9176-19987842b743 for instance f9baaee9-8fae-43c6-9194-4e0a6d56eee0 on hv-cinder-81914 Jul 11 14:16:18.721888 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-c6ab1fa3-53c7-4213-86e8-453a81435c9c req-bff5b441-0f05-4e59-8bf7-81ed77e99b67 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033020 Jul 11 14:16:18.722842 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 183/352] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:19.322956 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-4b6829b9-672c-4a78-af5d-f7aea1e55433 req-9e0d3f8e-3db1-403d-a495-45d953d48f16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374e3321-9408-4c7b-b2c3-8be5d7ed6561", "tag": "6d373871-6631-4afb-9527-c160464851a2"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:19.332447 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4b6829b9-672c-4a78-af5d-f7aea1e55433 req-9e0d3f8e-3db1-403d-a495-45d953d48f16 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:19.333833 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4b6829b9-672c-4a78-af5d-f7aea1e55433 req-9e0d3f8e-3db1-403d-a495-45d953d48f16 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:19.349709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-4b6829b9-672c-4a78-af5d-f7aea1e55433 req-9e0d3f8e-3db1-403d-a495-45d953d48f16 service nova] Creating event network-changed:6d373871-6631-4afb-9527-c160464851a2 for instance 374e3321-9408-4c7b-b2c3-8be5d7ed6561 on hv-cinder-81914 Jul 11 14:16:19.357603 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-4b6829b9-672c-4a78-af5d-f7aea1e55433 req-9e0d3f8e-3db1-403d-a495-45d953d48f16 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037620 Jul 11 14:16:19.359954 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 170/353] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:19.625145 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cd16b707-3920-47e8-9e2e-ed34354ef6bc tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:19.625917 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cd16b707-3920-47e8-9e2e-ed34354ef6bc tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] [instance: f9baaee9-8fae-43c6-9194-4e0a6d56eee0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:19.633107 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd16b707-3920-47e8-9e2e-ed34354ef6bc tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:19.633524 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd16b707-3920-47e8-9e2e-ed34354ef6bc tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:19.634412 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd16b707-3920-47e8-9e2e-ed34354ef6bc tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:19.634906 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd16b707-3920-47e8-9e2e-ed34354ef6bc tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:19.651520 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-cd16b707-3920-47e8-9e2e-ed34354ef6bc tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] HTTP exception thrown: Instance f9baaee9-8fae-43c6-9194-4e0a6d56eee0 could not be found. Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cd16b707-3920-47e8-9e2e-ed34354ef6bc tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Request method failure captured: Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 HTTP/1.1 Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDB72exfDX6CD0-Nd8Hrq2jtty3plMX6A2-AsSEScnmMPX43OGNsQVxclDqB1VjPDTSm1cXc0QDw_iGPX09mVRgOumGuok5t9SjjyWetWAz80lU4ECMv7GvLtx4V0R9k-4GNkZ8eYat_9IdNi0iIXpbozu6lGSHRFpjPZyBVpSNbRm0 Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: bdc81783ff1f4a47b617e77618303f94 Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesActionsTest-1989461559 Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:16:19.653444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:16:19.655456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bdc81783ff1f4a47b617e77618303f94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bdc81783ff1f4a47b617e77618303f94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bdc81783ff1f4a47b617e77618303f94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bdc81783ff1f4a47b617e77618303f94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:16:19.655456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesActionsTest-1989461559 Jul 11 14:16:19.655456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: bdc81783ff1f4a47b617e77618303f94 Jul 11 14:16:19.655456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesActionsTest-1989461559 Jul 11 14:16:19.655456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesActionsTest-1989461559-project Jul 11 14:16:19.655456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:16:19.655456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:16:19.655456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: bf2b65c48bc141abbd3c56b791b213ae Jul 11 14:16:19.655456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesActionsTest-1989461559-project Jul 11 14:16:19.655456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:16:19.655456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance f9baaee9-8fae-43c6-9194-4e0a6d56eee0 could not be found. Jul 11 14:16:19.655456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': 'f9baaee9-8fae-43c6-9194-4e0a6d56eee0'} Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9baaee9-8fae-43c6-9194-4e0a6d56eee0 could not be found. Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:16:19.656206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:16:19.658037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:16:19.658037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:16:19.658037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:16:19.658037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:16:19.658037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:16:19.658037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:16:19.658037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:16:19.658037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9baaee9-8fae-43c6-9194-4e0a6d56eee0 could not be found. Jul 11 14:16:19.658037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:16:19.658037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:16:19.658037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:16:19.658037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:16:19.658037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:16:19.658037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:16:19.658037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:16:19.658037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:16:19.658037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9baaee9-8fae-43c6-9194-4e0a6d56eee0 could not be found. Jul 11 14:16:19.658037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:16:19.660721 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cd16b707-3920-47e8-9e2e-ed34354ef6bc tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] Returning 404 to user: Instance f9baaee9-8fae-43c6-9194-4e0a6d56eee0 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:16:19.661698 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cd16b707-3920-47e8-9e2e-ed34354ef6bc tempest-VolumesActionsTest-1989461559 tempest-VolumesActionsTest-1989461559-project] 10.222.0.66 "GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0" status: 404 len: 111 microversion: 2.1 time: 0.041268 Jul 11 14:16:19.662369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 184/354] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:19 2022] GET /compute/v2.1/servers/f9baaee9-8fae-43c6-9194-4e0a6d56eee0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:16:25.866500 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f5aa122b-58ed-434b-be6d-f825a5733e86 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1281409998", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2127391203", "security_groups": [{"name": "tempest-secgroup-smoke-144034367"}], "block_device_mapping_v2": [{"uuid": "c0541b03-5b6c-4429-b923-dbe787f0bf38", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61698ae3-86b6-41a7-9062-ee7a458ad7a1"}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:26.013257 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-f5aa122b-58ed-434b-be6d-f825a5733e86 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] validate_networks() for [('61698ae3-86b6-41a7-9062-ee7a458ad7a1', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:16:26.490429 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-f5aa122b-58ed-434b-be6d-f825a5733e86 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:16:26.490864 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-f5aa122b-58ed-434b-be6d-f825a5733e86 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:16:26.491596 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-f5aa122b-58ed-434b-be6d-f825a5733e86 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:16:26.492448 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-f5aa122b-58ed-434b-be6d-f825a5733e86 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:16:26.493037 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-f5aa122b-58ed-434b-be6d-f825a5733e86 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:16:26.502820 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f5aa122b-58ed-434b-be6d-f825a5733e86 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:26.503940 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f5aa122b-58ed-434b-be6d-f825a5733e86 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:26.504910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f5aa122b-58ed-434b-be6d-f825a5733e86 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:26.505505 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f5aa122b-58ed-434b-be6d-f825a5733e86 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:26.524188 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-f5aa122b-58ed-434b-be6d-f825a5733e86 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Getting quotas for project 8da67a5ec9194e7bad1eb52c45a584bf. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:16:26.528661 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-f5aa122b-58ed-434b-be6d-f825a5733e86 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Getting quotas for user 5383a1d1bec34094a1889a86d87a88b5 and project 8da67a5ec9194e7bad1eb52c45a584bf. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:16:26.615806 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f5aa122b-58ed-434b-be6d-f825a5733e86 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:16:26.619305 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f5aa122b-58ed-434b-be6d-f825a5733e86 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c0541b03-5b6c-4429-b923-dbe787f0bf38',volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:16:26.798039 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f5aa122b-58ed-434b-be6d-f825a5733e86 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.936860 Jul 11 14:16:26.798885 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 171/355] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:16:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:16:26.808653 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d0e47ff4-8c8b-4937-a1c5-508b063aaa2a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:26.814927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d0e47ff4-8c8b-4937-a1c5-508b063aaa2a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:26.887881 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d0e47ff4-8c8b-4937-a1c5-508b063aaa2a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:26.897439 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d0e47ff4-8c8b-4937-a1c5-508b063aaa2a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1095 microversion: 2.1 time: 0.092640 Jul 11 14:16:26.898308 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 185/356] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:26 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1095 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:27.919336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-45b7058e-17cb-45ff-9651-19ab785432ad tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:27.929583 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-45b7058e-17cb-45ff-9651-19ab785432ad tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:27.938369 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45b7058e-17cb-45ff-9651-19ab785432ad tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:27.938821 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45b7058e-17cb-45ff-9651-19ab785432ad tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:27.939920 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45b7058e-17cb-45ff-9651-19ab785432ad tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:27.940348 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45b7058e-17cb-45ff-9651-19ab785432ad tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:28.022721 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-45b7058e-17cb-45ff-9651-19ab785432ad tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:28.033581 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-45b7058e-17cb-45ff-9651-19ab785432ad tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1193 microversion: 2.1 time: 0.121245 Jul 11 14:16:28.034992 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 172/357] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:27 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1193 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:29.053600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5a1c5c56-625f-462c-ac6e-05973e4e5358 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:29.056998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5a1c5c56-625f-462c-ac6e-05973e4e5358 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:29.073486 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a1c5c56-625f-462c-ac6e-05973e4e5358 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:29.075258 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a1c5c56-625f-462c-ac6e-05973e4e5358 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:29.078020 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a1c5c56-625f-462c-ac6e-05973e4e5358 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:29.078741 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a1c5c56-625f-462c-ac6e-05973e4e5358 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:29.175685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5a1c5c56-625f-462c-ac6e-05973e4e5358 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:29.183692 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5a1c5c56-625f-462c-ac6e-05973e4e5358 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1211 microversion: 2.1 time: 0.134288 Jul 11 14:16:29.184276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 186/358] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:29 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1211 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:30.202888 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0122c1e2-3238-4297-b492-4a7c206e1dc0 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:30.204504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0122c1e2-3238-4297-b492-4a7c206e1dc0 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:30.222231 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0122c1e2-3238-4297-b492-4a7c206e1dc0 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:30.225658 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0122c1e2-3238-4297-b492-4a7c206e1dc0 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:30.226824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0122c1e2-3238-4297-b492-4a7c206e1dc0 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:30.229251 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0122c1e2-3238-4297-b492-4a7c206e1dc0 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:30.468028 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-68cc25a7-3f92-4256-9f1b-78141ff94807 req-6472af3f-6eba-4bef-83f8-78c9e71172b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7530cb60-25fa-4960-b9e9-00c48a4a7eff", "tag": "c739f650-9402-41b8-aabb-ffdf7370fe7c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:30.485893 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0122c1e2-3238-4297-b492-4a7c206e1dc0 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:30.500726 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-68cc25a7-3f92-4256-9f1b-78141ff94807 req-6472af3f-6eba-4bef-83f8-78c9e71172b3 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:30.501487 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0122c1e2-3238-4297-b492-4a7c206e1dc0 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1266 microversion: 2.1 time: 0.304075 Jul 11 14:16:30.501867 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-68cc25a7-3f92-4256-9f1b-78141ff94807 req-6472af3f-6eba-4bef-83f8-78c9e71172b3 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:30.502177 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 173/359] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:30 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1266 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:30.517634 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-68cc25a7-3f92-4256-9f1b-78141ff94807 req-6472af3f-6eba-4bef-83f8-78c9e71172b3 service nova] Creating event network-changed:c739f650-9402-41b8-aabb-ffdf7370fe7c for instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff on hv-cinder-81914 Jul 11 14:16:30.528389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-68cc25a7-3f92-4256-9f1b-78141ff94807 req-6472af3f-6eba-4bef-83f8-78c9e71172b3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065338 Jul 11 14:16:30.530092 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 187/360] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:31.519182 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-98740633-782b-45f3-8302-b9a396277e30 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:31.521065 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-98740633-782b-45f3-8302-b9a396277e30 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:31.532449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98740633-782b-45f3-8302-b9a396277e30 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:31.533006 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98740633-782b-45f3-8302-b9a396277e30 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:31.533877 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98740633-782b-45f3-8302-b9a396277e30 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:31.535007 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98740633-782b-45f3-8302-b9a396277e30 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:31.713157 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-98740633-782b-45f3-8302-b9a396277e30 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:31.731065 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-98740633-782b-45f3-8302-b9a396277e30 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1266 microversion: 2.1 time: 0.215787 Jul 11 14:16:31.745941 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 174/361] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:31 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:32.750551 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c2f2b8cb-60a9-4acf-9250-b28bcf15bcf8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:32.751161 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c2f2b8cb-60a9-4acf-9250-b28bcf15bcf8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:32.765722 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2f2b8cb-60a9-4acf-9250-b28bcf15bcf8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:32.766693 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2f2b8cb-60a9-4acf-9250-b28bcf15bcf8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:32.767671 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2f2b8cb-60a9-4acf-9250-b28bcf15bcf8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:32.768262 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2f2b8cb-60a9-4acf-9250-b28bcf15bcf8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:32.917896 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c2f2b8cb-60a9-4acf-9250-b28bcf15bcf8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:32.929827 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c2f2b8cb-60a9-4acf-9250-b28bcf15bcf8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1266 microversion: 2.1 time: 0.185252 Jul 11 14:16:32.930467 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 188/362] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:32 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:33.947514 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-95b48448-4bef-44f1-b76c-9d79a80ab06e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:33.948157 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-95b48448-4bef-44f1-b76c-9d79a80ab06e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:33.955862 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95b48448-4bef-44f1-b76c-9d79a80ab06e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:33.956313 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95b48448-4bef-44f1-b76c-9d79a80ab06e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:33.957175 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95b48448-4bef-44f1-b76c-9d79a80ab06e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:33.957641 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95b48448-4bef-44f1-b76c-9d79a80ab06e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:34.100838 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-95b48448-4bef-44f1-b76c-9d79a80ab06e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:34.114838 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-95b48448-4bef-44f1-b76c-9d79a80ab06e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1266 microversion: 2.1 time: 0.170765 Jul 11 14:16:34.115546 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 175/363] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:33 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:35.133826 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e10a2331-3925-4942-baf1-48cec2f7f390 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:35.134426 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e10a2331-3925-4942-baf1-48cec2f7f390 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:35.141955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e10a2331-3925-4942-baf1-48cec2f7f390 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:35.142488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e10a2331-3925-4942-baf1-48cec2f7f390 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:35.143265 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e10a2331-3925-4942-baf1-48cec2f7f390 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:35.143658 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e10a2331-3925-4942-baf1-48cec2f7f390 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:35.300742 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e10a2331-3925-4942-baf1-48cec2f7f390 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:35.308873 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e10a2331-3925-4942-baf1-48cec2f7f390 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1266 microversion: 2.1 time: 0.179188 Jul 11 14:16:35.309771 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 189/364] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:35 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:36.325654 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a09430ef-9eb2-465a-8faa-9338cd0c165a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:36.326321 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a09430ef-9eb2-465a-8faa-9338cd0c165a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:36.333002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a09430ef-9eb2-465a-8faa-9338cd0c165a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:36.333881 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a09430ef-9eb2-465a-8faa-9338cd0c165a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:36.334271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a09430ef-9eb2-465a-8faa-9338cd0c165a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:36.334963 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a09430ef-9eb2-465a-8faa-9338cd0c165a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:36.480685 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a09430ef-9eb2-465a-8faa-9338cd0c165a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:36.490254 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a09430ef-9eb2-465a-8faa-9338cd0c165a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1266 microversion: 2.1 time: 0.168366 Jul 11 14:16:36.491046 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 176/365] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:36 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:16:37.510066 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ae926444-3fa2-4877-abf9-c2ebb26f66a9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:37.510066 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ae926444-3fa2-4877-abf9-c2ebb26f66a9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:37.515193 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:37.517434 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae926444-3fa2-4877-abf9-c2ebb26f66a9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:37.517886 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae926444-3fa2-4877-abf9-c2ebb26f66a9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:37.518828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae926444-3fa2-4877-abf9-c2ebb26f66a9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:37.519273 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae926444-3fa2-4877-abf9-c2ebb26f66a9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:37.682063 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ae926444-3fa2-4877-abf9-c2ebb26f66a9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:37.689910 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ae926444-3fa2-4877-abf9-c2ebb26f66a9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1266 microversion: 2.1 time: 0.186334 Jul 11 14:16:37.699679 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 190/366] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:37 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:38.721940 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2d38c09f-54ca-4a59-966a-000f1da80627 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:38.723058 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2d38c09f-54ca-4a59-966a-000f1da80627 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:38.729955 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:38.731836 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:38.737489 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2d38c09f-54ca-4a59-966a-000f1da80627 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:38.737959 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2d38c09f-54ca-4a59-966a-000f1da80627 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:38.739750 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2d38c09f-54ca-4a59-966a-000f1da80627 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:38.740780 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2d38c09f-54ca-4a59-966a-000f1da80627 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:38.901320 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2d38c09f-54ca-4a59-966a-000f1da80627 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:38.910200 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2d38c09f-54ca-4a59-966a-000f1da80627 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1266 microversion: 2.1 time: 0.194828 Jul 11 14:16:38.911439 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 177/367] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:38 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:39.947271 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bbae0ac4-759c-44b5-9a1e-e77b1d0244aa tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:39.948156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bbae0ac4-759c-44b5-9a1e-e77b1d0244aa tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:39.958649 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bbae0ac4-759c-44b5-9a1e-e77b1d0244aa tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:39.959479 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bbae0ac4-759c-44b5-9a1e-e77b1d0244aa tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:39.960792 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bbae0ac4-759c-44b5-9a1e-e77b1d0244aa tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:39.961838 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bbae0ac4-759c-44b5-9a1e-e77b1d0244aa tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:40.136194 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bbae0ac4-759c-44b5-9a1e-e77b1d0244aa tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:40.144532 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bbae0ac4-759c-44b5-9a1e-e77b1d0244aa tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1266 microversion: 2.1 time: 0.202157 Jul 11 14:16:40.145315 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 191/368] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:39 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:41.161240 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2e5f615d-269f-464c-b505-7977033a2609 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:41.161913 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2e5f615d-269f-464c-b505-7977033a2609 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:41.168341 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e5f615d-269f-464c-b505-7977033a2609 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:41.168786 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e5f615d-269f-464c-b505-7977033a2609 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:41.169588 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e5f615d-269f-464c-b505-7977033a2609 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:41.170008 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e5f615d-269f-464c-b505-7977033a2609 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:41.309049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2e5f615d-269f-464c-b505-7977033a2609 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:41.317484 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2e5f615d-269f-464c-b505-7977033a2609 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1266 microversion: 2.1 time: 0.160236 Jul 11 14:16:41.318059 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 178/369] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:41 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:42.334134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f5012286-c9ff-4149-9bfc-d8637a987a45 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:42.334783 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f5012286-c9ff-4149-9bfc-d8637a987a45 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:42.342695 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5012286-c9ff-4149-9bfc-d8637a987a45 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:42.343063 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5012286-c9ff-4149-9bfc-d8637a987a45 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:42.343863 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5012286-c9ff-4149-9bfc-d8637a987a45 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:42.344286 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5012286-c9ff-4149-9bfc-d8637a987a45 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:42.493981 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f5012286-c9ff-4149-9bfc-d8637a987a45 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:42.506276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f5012286-c9ff-4149-9bfc-d8637a987a45 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1266 microversion: 2.1 time: 0.175913 Jul 11 14:16:42.507198 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 192/370] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:42 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:42.601352 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-adfde285-d73a-475b-9f58-66a696fcb13d req-9b5ba010-5daf-441d-b287-34d7acaa092a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7530cb60-25fa-4960-b9e9-00c48a4a7eff", "name": "network-vif-plugged", "status": "completed", "tag": "c739f650-9402-41b8-aabb-ffdf7370fe7c"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:42.611099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:42.613641 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-adfde285-d73a-475b-9f58-66a696fcb13d req-9b5ba010-5daf-441d-b287-34d7acaa092a service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:42.614074 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-adfde285-d73a-475b-9f58-66a696fcb13d req-9b5ba010-5daf-441d-b287-34d7acaa092a service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:42.618979 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=92 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:42.628885 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-adfde285-d73a-475b-9f58-66a696fcb13d req-9b5ba010-5daf-441d-b287-34d7acaa092a service nova] Creating event network-vif-plugged:c739f650-9402-41b8-aabb-ffdf7370fe7c for instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff on hv-cinder-81914 Jul 11 14:16:42.634314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-adfde285-d73a-475b-9f58-66a696fcb13d req-9b5ba010-5daf-441d-b287-34d7acaa092a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037710 Jul 11 14:16:42.635021 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 179/371] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:43.524095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-42ec71ee-8824-4efc-bc99-416000510469 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:43.524624 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-42ec71ee-8824-4efc-bc99-416000510469 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:43.531316 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42ec71ee-8824-4efc-bc99-416000510469 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:43.531769 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42ec71ee-8824-4efc-bc99-416000510469 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:43.532563 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42ec71ee-8824-4efc-bc99-416000510469 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:43.532978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42ec71ee-8824-4efc-bc99-416000510469 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:43.666465 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-42ec71ee-8824-4efc-bc99-416000510469 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:43.674976 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-42ec71ee-8824-4efc-bc99-416000510469 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1266 microversion: 2.1 time: 0.154784 Jul 11 14:16:43.675555 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 193/372] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:43 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:16:44.693317 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c132a5e0-4428-48c5-98b3-b550194b8000 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:44.694033 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c132a5e0-4428-48c5-98b3-b550194b8000 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:44.701422 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c132a5e0-4428-48c5-98b3-b550194b8000 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:44.701882 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c132a5e0-4428-48c5-98b3-b550194b8000 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:44.702694 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c132a5e0-4428-48c5-98b3-b550194b8000 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:44.703137 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c132a5e0-4428-48c5-98b3-b550194b8000 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:44.855057 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c132a5e0-4428-48c5-98b3-b550194b8000 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:44.867616 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c132a5e0-4428-48c5-98b3-b550194b8000 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1266 microversion: 2.1 time: 0.179224 Jul 11 14:16:44.868212 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 180/373] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:44 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:45.889586 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8e2c1c63-5cca-464b-8f2a-469113c4a184 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:45.890247 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8e2c1c63-5cca-464b-8f2a-469113c4a184 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:45.892598 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:45.898899 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e2c1c63-5cca-464b-8f2a-469113c4a184 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:45.899189 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e2c1c63-5cca-464b-8f2a-469113c4a184 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:45.900233 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e2c1c63-5cca-464b-8f2a-469113c4a184 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:45.900643 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e2c1c63-5cca-464b-8f2a-469113c4a184 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:45.907421 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:46.041108 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8e2c1c63-5cca-464b-8f2a-469113c4a184 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:46.049451 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8e2c1c63-5cca-464b-8f2a-469113c4a184 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1452 microversion: 2.1 time: 0.166006 Jul 11 14:16:46.050021 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 194/374] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:45 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:46.065416 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-44512dfe-3db6-4d31-976b-8e069f54a7bd tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:46.066037 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-44512dfe-3db6-4d31-976b-8e069f54a7bd tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:46.072592 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-44512dfe-3db6-4d31-976b-8e069f54a7bd tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:46.073050 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-44512dfe-3db6-4d31-976b-8e069f54a7bd tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:46.073817 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-44512dfe-3db6-4d31-976b-8e069f54a7bd tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:46.074284 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-44512dfe-3db6-4d31-976b-8e069f54a7bd tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:46.216658 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-44512dfe-3db6-4d31-976b-8e069f54a7bd tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:46.224515 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-44512dfe-3db6-4d31-976b-8e069f54a7bd tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1452 microversion: 2.1 time: 0.162986 Jul 11 14:16:46.225088 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 181/375] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:46 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:48.150933 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-a1dddcbc-52b5-462f-98cc-12c041875de9 req-0ecde55b-8609-44a7-8391-de2389e9b5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7530cb60-25fa-4960-b9e9-00c48a4a7eff", "tag": "c739f650-9402-41b8-aabb-ffdf7370fe7c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:48.160890 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a1dddcbc-52b5-462f-98cc-12c041875de9 req-0ecde55b-8609-44a7-8391-de2389e9b5d7 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:48.161519 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a1dddcbc-52b5-462f-98cc-12c041875de9 req-0ecde55b-8609-44a7-8391-de2389e9b5d7 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:48.173527 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-a1dddcbc-52b5-462f-98cc-12c041875de9 req-0ecde55b-8609-44a7-8391-de2389e9b5d7 service nova] Creating event network-changed:c739f650-9402-41b8-aabb-ffdf7370fe7c for instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff on hv-cinder-81914 Jul 11 14:16:48.178734 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-a1dddcbc-52b5-462f-98cc-12c041875de9 req-0ecde55b-8609-44a7-8391-de2389e9b5d7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031504 Jul 11 14:16:48.179452 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 195/376] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:58.748369 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-59b9130a-1f96-45a7-a288-f301540dcbfe tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94ff885c-de3b-4af9-a1d5-0792f8fac37a"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:58.749449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-59b9130a-1f96-45a7-a288-f301540dcbfe tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:58.751909 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=5 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:58.752566 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=13 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:58.758386 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-59b9130a-1f96-45a7-a288-f301540dcbfe tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:58.758838 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-59b9130a-1f96-45a7-a288-f301540dcbfe tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:58.759623 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-59b9130a-1f96-45a7-a288-f301540dcbfe tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:58.760062 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-59b9130a-1f96-45a7-a288-f301540dcbfe tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:59.036396 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-59b9130a-1f96-45a7-a288-f301540dcbfe tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "POST /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292541 Jul 11 14:16:59.037025 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 182/377] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 11 14:16:58 2022] POST /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:17:03.346949 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:03.347689 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=7 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:03.352584 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4d37f830-2411-49f2-8f12-785493566e11 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:03.353167 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4d37f830-2411-49f2-8f12-785493566e11 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:03.360940 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d37f830-2411-49f2-8f12-785493566e11 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:03.361391 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d37f830-2411-49f2-8f12-785493566e11 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:03.362174 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d37f830-2411-49f2-8f12-785493566e11 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:03.362614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d37f830-2411-49f2-8f12-785493566e11 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:03.487149 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-4d37f830-2411-49f2-8f12-785493566e11 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lazy-loading 'services' on Instance uuid 22f5f00b-3f48-4d27-9330-2b61cfa19d27 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:17:03.603710 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4d37f830-2411-49f2-8f12-785493566e11 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "DELETE /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27/os-volume_attachments/18a22eee-33a3-4316-8c14-08aa0af68f06" status: 202 len: 0 microversion: 2.1 time: 0.258091 Jul 11 14:17:03.604493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 196/378] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 11 14:17:03 2022] DELETE /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27/os-volume_attachments/18a22eee-33a3-4316-8c14-08aa0af68f06 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:17:06.560817 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e7c67fe3-fe09-40ef-8089-bb559f44e3e0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:06.561834 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e7c67fe3-fe09-40ef-8089-bb559f44e3e0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:06.567989 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7c67fe3-fe09-40ef-8089-bb559f44e3e0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:06.568435 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7c67fe3-fe09-40ef-8089-bb559f44e3e0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:06.569187 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7c67fe3-fe09-40ef-8089-bb559f44e3e0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:06.569614 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7c67fe3-fe09-40ef-8089-bb559f44e3e0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:06.593364 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-e7c67fe3-fe09-40ef-8089-bb559f44e3e0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lazy-loading 'flavor' on Instance uuid 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:17:06.738068 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e7c67fe3-fe09-40ef-8089-bb559f44e3e0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "POST /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/action" status: 200 len: 32 microversion: 2.1 time: 0.182395 Jul 11 14:17:06.739396 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 183/379] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 11 14:17:06 2022] POST /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/action => generated 32 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 14:17:06.751092 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3231789c-99f6-432a-9ff5-aee789e0df16 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:06.752007 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3231789c-99f6-432a-9ff5-aee789e0df16 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:06.761722 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3231789c-99f6-432a-9ff5-aee789e0df16 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:06.762326 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3231789c-99f6-432a-9ff5-aee789e0df16 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:06.763212 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3231789c-99f6-432a-9ff5-aee789e0df16 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:06.763686 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3231789c-99f6-432a-9ff5-aee789e0df16 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:06.945858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3231789c-99f6-432a-9ff5-aee789e0df16 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:06.955251 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3231789c-99f6-432a-9ff5-aee789e0df16 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1736 microversion: 2.1 time: 0.209987 Jul 11 14:17:06.956149 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 197/380] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:06 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:07.899072 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0d4f2a47-e5b4-4f35-af9c-80c0ff26b3ad tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:07.906537 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0d4f2a47-e5b4-4f35-af9c-80c0ff26b3ad tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:07.906990 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0d4f2a47-e5b4-4f35-af9c-80c0ff26b3ad tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:07.930717 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0d4f2a47-e5b4-4f35-af9c-80c0ff26b3ad tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Going to try to stop instance {{(pid=117921) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 11 14:17:07.973438 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f9d43a04-f745-49ef-a690-e69eaa35b7af tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:07.974118 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f9d43a04-f745-49ef-a690-e69eaa35b7af tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:07.976742 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0d4f2a47-e5b4-4f35-af9c-80c0ff26b3ad tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "POST /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27/action" status: 202 len: 0 microversion: 2.1 time: 0.082199 Jul 11 14:17:07.977980 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 184/381] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 11 14:17:07 2022] POST /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:17:07.981511 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9d43a04-f745-49ef-a690-e69eaa35b7af tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:07.981968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9d43a04-f745-49ef-a690-e69eaa35b7af tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:07.982779 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9d43a04-f745-49ef-a690-e69eaa35b7af tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:07.983220 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9d43a04-f745-49ef-a690-e69eaa35b7af tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:07.985924 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-975622d7-42bb-4a12-b1c2-698d1f73a97f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:07.986709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-975622d7-42bb-4a12-b1c2-698d1f73a97f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:07.992964 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-975622d7-42bb-4a12-b1c2-698d1f73a97f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:07.993602 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-975622d7-42bb-4a12-b1c2-698d1f73a97f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:07.994121 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-975622d7-42bb-4a12-b1c2-698d1f73a97f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:07.994640 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-975622d7-42bb-4a12-b1c2-698d1f73a97f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:08.129737 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f9d43a04-f745-49ef-a690-e69eaa35b7af tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:08.133549 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-975622d7-42bb-4a12-b1c2-698d1f73a97f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:08.142487 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-975622d7-42bb-4a12-b1c2-698d1f73a97f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1677 microversion: 2.1 time: 0.160461 Jul 11 14:17:08.143100 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 185/382] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:07 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:17:08.145412 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f9d43a04-f745-49ef-a690-e69eaa35b7af tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1736 microversion: 2.1 time: 0.176382 Jul 11 14:17:08.145995 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 198/383] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:07 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:17:09.160179 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d2daaf6e-7f92-49d0-a1f5-f51cf7ea8e0e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:09.160780 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d2daaf6e-7f92-49d0-a1f5-f51cf7ea8e0e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:09.163293 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c3ee941e-cedd-4824-8322-b27861cf82b6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:09.163916 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c3ee941e-cedd-4824-8322-b27861cf82b6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:09.168276 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2daaf6e-7f92-49d0-a1f5-f51cf7ea8e0e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:09.168725 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2daaf6e-7f92-49d0-a1f5-f51cf7ea8e0e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:09.169510 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2daaf6e-7f92-49d0-a1f5-f51cf7ea8e0e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:09.169946 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2daaf6e-7f92-49d0-a1f5-f51cf7ea8e0e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:09.170097 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3ee941e-cedd-4824-8322-b27861cf82b6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:09.170549 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3ee941e-cedd-4824-8322-b27861cf82b6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:09.171317 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3ee941e-cedd-4824-8322-b27861cf82b6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:09.171750 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3ee941e-cedd-4824-8322-b27861cf82b6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:09.312644 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c3ee941e-cedd-4824-8322-b27861cf82b6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:09.313136 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d2daaf6e-7f92-49d0-a1f5-f51cf7ea8e0e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:09.320763 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c3ee941e-cedd-4824-8322-b27861cf82b6 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1736 microversion: 2.1 time: 0.162036 Jul 11 14:17:09.321247 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d2daaf6e-7f92-49d0-a1f5-f51cf7ea8e0e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1677 microversion: 2.1 time: 0.164990 Jul 11 14:17:09.321613 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 199/384] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:09 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:17:09.322531 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 186/385] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:09 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:10.339462 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cdbe0446-f61a-4636-96e1-6fad7b344d36 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:10.340167 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cdbe0446-f61a-4636-96e1-6fad7b344d36 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:10.340262 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-97c4d8e4-9305-496f-9627-fc017478cd3d tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:10.340844 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-97c4d8e4-9305-496f-9627-fc017478cd3d tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:10.346956 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cdbe0446-f61a-4636-96e1-6fad7b344d36 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:10.347406 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cdbe0446-f61a-4636-96e1-6fad7b344d36 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:10.347540 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97c4d8e4-9305-496f-9627-fc017478cd3d tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:10.347896 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97c4d8e4-9305-496f-9627-fc017478cd3d tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:10.348185 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cdbe0446-f61a-4636-96e1-6fad7b344d36 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:10.348619 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cdbe0446-f61a-4636-96e1-6fad7b344d36 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:10.348740 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97c4d8e4-9305-496f-9627-fc017478cd3d tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:10.349086 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97c4d8e4-9305-496f-9627-fc017478cd3d tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:10.486872 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-97c4d8e4-9305-496f-9627-fc017478cd3d tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:10.487361 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cdbe0446-f61a-4636-96e1-6fad7b344d36 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:10.495155 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-97c4d8e4-9305-496f-9627-fc017478cd3d tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1677 microversion: 2.1 time: 0.159364 Jul 11 14:17:10.496632 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 200/386] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:10 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:10.496897 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cdbe0446-f61a-4636-96e1-6fad7b344d36 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1736 microversion: 2.1 time: 0.161279 Jul 11 14:17:10.497478 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 187/387] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:10 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:17:11.513870 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bcd29e09-01c9-4849-aa72-36ca195a77af tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:11.514529 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d5ccd56f-77e6-4f7f-a84f-b991fa3cbc1a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:11.514529 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d5ccd56f-77e6-4f7f-a84f-b991fa3cbc1a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:11.514991 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bcd29e09-01c9-4849-aa72-36ca195a77af tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:11.521105 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcd29e09-01c9-4849-aa72-36ca195a77af tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:11.521276 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d5ccd56f-77e6-4f7f-a84f-b991fa3cbc1a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:11.521557 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcd29e09-01c9-4849-aa72-36ca195a77af tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:11.521667 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d5ccd56f-77e6-4f7f-a84f-b991fa3cbc1a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:11.522353 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcd29e09-01c9-4849-aa72-36ca195a77af tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:11.522458 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d5ccd56f-77e6-4f7f-a84f-b991fa3cbc1a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:11.522790 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcd29e09-01c9-4849-aa72-36ca195a77af tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:11.522916 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d5ccd56f-77e6-4f7f-a84f-b991fa3cbc1a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:11.661897 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bcd29e09-01c9-4849-aa72-36ca195a77af tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:11.662993 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d5ccd56f-77e6-4f7f-a84f-b991fa3cbc1a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:11.671003 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bcd29e09-01c9-4849-aa72-36ca195a77af tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1677 microversion: 2.1 time: 0.160963 Jul 11 14:17:11.673199 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d5ccd56f-77e6-4f7f-a84f-b991fa3cbc1a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1736 microversion: 2.1 time: 0.163116 Jul 11 14:17:11.673790 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 188/388] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:11 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:17:11.674099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 201/389] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:11 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:12.688685 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fb2d6d8e-7036-4b5a-9366-1dfedb4005ca tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:12.689344 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fb2d6d8e-7036-4b5a-9366-1dfedb4005ca tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:12.690073 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0ba3016b-0cf9-41c2-a9b5-4cac5b33b277 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:12.690733 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0ba3016b-0cf9-41c2-a9b5-4cac5b33b277 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:12.695770 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fb2d6d8e-7036-4b5a-9366-1dfedb4005ca tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:12.696224 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fb2d6d8e-7036-4b5a-9366-1dfedb4005ca tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:12.697016 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fb2d6d8e-7036-4b5a-9366-1dfedb4005ca tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:12.697330 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ba3016b-0cf9-41c2-a9b5-4cac5b33b277 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:12.697462 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fb2d6d8e-7036-4b5a-9366-1dfedb4005ca tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:12.697783 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ba3016b-0cf9-41c2-a9b5-4cac5b33b277 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:12.698599 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ba3016b-0cf9-41c2-a9b5-4cac5b33b277 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:12.699036 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ba3016b-0cf9-41c2-a9b5-4cac5b33b277 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:12.833785 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0ba3016b-0cf9-41c2-a9b5-4cac5b33b277 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:12.836220 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fb2d6d8e-7036-4b5a-9366-1dfedb4005ca tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:12.841909 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0ba3016b-0cf9-41c2-a9b5-4cac5b33b277 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1736 microversion: 2.1 time: 0.155551 Jul 11 14:17:12.842524 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 202/390] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:12 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:17:12.844448 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fb2d6d8e-7036-4b5a-9366-1dfedb4005ca tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1677 microversion: 2.1 time: 0.159600 Jul 11 14:17:12.845020 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 189/391] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:12 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:13.860445 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-03d9c974-ea67-44e5-ac8a-dd2bcc9b91e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:13.861042 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-03d9c974-ea67-44e5-ac8a-dd2bcc9b91e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:13.862052 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8319dcf4-3a89-40d8-811f-339772b01ed7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:13.862798 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8319dcf4-3a89-40d8-811f-339772b01ed7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:13.867882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03d9c974-ea67-44e5-ac8a-dd2bcc9b91e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:13.868293 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03d9c974-ea67-44e5-ac8a-dd2bcc9b91e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:13.869081 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03d9c974-ea67-44e5-ac8a-dd2bcc9b91e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:13.869216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8319dcf4-3a89-40d8-811f-339772b01ed7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:13.869518 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03d9c974-ea67-44e5-ac8a-dd2bcc9b91e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:13.869644 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8319dcf4-3a89-40d8-811f-339772b01ed7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:13.870368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8319dcf4-3a89-40d8-811f-339772b01ed7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:13.870781 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8319dcf4-3a89-40d8-811f-339772b01ed7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:14.003682 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8319dcf4-3a89-40d8-811f-339772b01ed7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:14.010707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-03d9c974-ea67-44e5-ac8a-dd2bcc9b91e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:14.011480 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8319dcf4-3a89-40d8-811f-339772b01ed7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1677 microversion: 2.1 time: 0.153352 Jul 11 14:17:14.012063 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 190/392] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:13 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:14.019061 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-03d9c974-ea67-44e5-ac8a-dd2bcc9b91e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1736 microversion: 2.1 time: 0.162849 Jul 11 14:17:14.019639 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 203/393] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:13 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:15.028377 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a8f6981b-71d3-4f8d-8bfd-6b851bde0a65 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:15.028987 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a8f6981b-71d3-4f8d-8bfd-6b851bde0a65 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:15.036021 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a8f6981b-71d3-4f8d-8bfd-6b851bde0a65 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:15.036469 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a8f6981b-71d3-4f8d-8bfd-6b851bde0a65 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:15.036762 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bb6bcb80-e187-4158-99ac-2c7e9c1125e3 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:15.037227 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a8f6981b-71d3-4f8d-8bfd-6b851bde0a65 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:15.037404 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bb6bcb80-e187-4158-99ac-2c7e9c1125e3 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:15.037654 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a8f6981b-71d3-4f8d-8bfd-6b851bde0a65 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:15.045177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb6bcb80-e187-4158-99ac-2c7e9c1125e3 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:15.045654 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb6bcb80-e187-4158-99ac-2c7e9c1125e3 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:15.046552 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb6bcb80-e187-4158-99ac-2c7e9c1125e3 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:15.047022 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb6bcb80-e187-4158-99ac-2c7e9c1125e3 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:15.185480 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a8f6981b-71d3-4f8d-8bfd-6b851bde0a65 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:15.187009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bb6bcb80-e187-4158-99ac-2c7e9c1125e3 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:15.195673 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a8f6981b-71d3-4f8d-8bfd-6b851bde0a65 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1677 microversion: 2.1 time: 0.171164 Jul 11 14:17:15.196419 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bb6bcb80-e187-4158-99ac-2c7e9c1125e3 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1736 microversion: 2.1 time: 0.163264 Jul 11 14:17:15.203590 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 204/394] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:15 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:15.208444 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 191/395] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:15 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:16.215957 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-08216421-67ad-47fc-b3c7-6e9327d99ab4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:16.216601 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-08216421-67ad-47fc-b3c7-6e9327d99ab4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:16.220974 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9bbef83f-c387-41fe-8bef-41941c9b6943 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:16.221599 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9bbef83f-c387-41fe-8bef-41941c9b6943 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:16.223649 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08216421-67ad-47fc-b3c7-6e9327d99ab4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:16.224103 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08216421-67ad-47fc-b3c7-6e9327d99ab4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:16.224878 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08216421-67ad-47fc-b3c7-6e9327d99ab4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:16.225312 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08216421-67ad-47fc-b3c7-6e9327d99ab4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:16.228459 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9bbef83f-c387-41fe-8bef-41941c9b6943 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:16.228945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9bbef83f-c387-41fe-8bef-41941c9b6943 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:16.230414 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9bbef83f-c387-41fe-8bef-41941c9b6943 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:16.231207 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9bbef83f-c387-41fe-8bef-41941c9b6943 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:16.364089 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-08216421-67ad-47fc-b3c7-6e9327d99ab4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:16.365924 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9bbef83f-c387-41fe-8bef-41941c9b6943 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:16.371895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-08216421-67ad-47fc-b3c7-6e9327d99ab4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1677 microversion: 2.1 time: 0.160666 Jul 11 14:17:16.372487 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 205/396] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:16 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:16.373989 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9bbef83f-c387-41fe-8bef-41941c9b6943 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1736 microversion: 2.1 time: 0.158025 Jul 11 14:17:16.374756 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 192/397] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:16 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:17.390310 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-34ac32bd-3931-484f-95b9-62d54161ca41 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:17.390919 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-34ac32bd-3931-484f-95b9-62d54161ca41 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:17.391409 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d05159ac-ce22-4275-a125-d6db6a4238cf tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:17.392062 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d05159ac-ce22-4275-a125-d6db6a4238cf tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:17.397528 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34ac32bd-3931-484f-95b9-62d54161ca41 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:17.397979 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34ac32bd-3931-484f-95b9-62d54161ca41 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:17.398547 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d05159ac-ce22-4275-a125-d6db6a4238cf tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:17.398785 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34ac32bd-3931-484f-95b9-62d54161ca41 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:17.398998 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d05159ac-ce22-4275-a125-d6db6a4238cf tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:17.399221 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34ac32bd-3931-484f-95b9-62d54161ca41 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:17.399773 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d05159ac-ce22-4275-a125-d6db6a4238cf tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:17.400210 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d05159ac-ce22-4275-a125-d6db6a4238cf tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:17.537703 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d05159ac-ce22-4275-a125-d6db6a4238cf tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:17.538522 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-34ac32bd-3931-484f-95b9-62d54161ca41 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:17.546131 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-34ac32bd-3931-484f-95b9-62d54161ca41 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1677 microversion: 2.1 time: 0.160284 Jul 11 14:17:17.546511 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d05159ac-ce22-4275-a125-d6db6a4238cf tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1736 microversion: 2.1 time: 0.158809 Jul 11 14:17:17.546731 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 206/398] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:17 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:17.547090 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 193/399] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:17 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:17:18.564069 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4d8b0888-f5ab-416d-9124-14104afeb6f5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:18.564713 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e89b8c5b-7781-40bb-8ba2-91ca32637ff7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:18.565112 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4d8b0888-f5ab-416d-9124-14104afeb6f5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:18.565221 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e89b8c5b-7781-40bb-8ba2-91ca32637ff7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:18.571133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e89b8c5b-7781-40bb-8ba2-91ca32637ff7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:18.571467 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4d8b0888-f5ab-416d-9124-14104afeb6f5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:18.571590 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e89b8c5b-7781-40bb-8ba2-91ca32637ff7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:18.571908 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4d8b0888-f5ab-416d-9124-14104afeb6f5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:18.572433 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e89b8c5b-7781-40bb-8ba2-91ca32637ff7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:18.572677 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4d8b0888-f5ab-416d-9124-14104afeb6f5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:18.572868 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e89b8c5b-7781-40bb-8ba2-91ca32637ff7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:18.573183 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4d8b0888-f5ab-416d-9124-14104afeb6f5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:18.577656 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:18.724831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4d8b0888-f5ab-416d-9124-14104afeb6f5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:18.733879 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4d8b0888-f5ab-416d-9124-14104afeb6f5 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1736 microversion: 2.1 time: 0.173384 Jul 11 14:17:18.734499 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 194/400] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:18 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:18.754775 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e89b8c5b-7781-40bb-8ba2-91ca32637ff7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:18.762580 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e89b8c5b-7781-40bb-8ba2-91ca32637ff7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1654 microversion: 2.1 time: 0.202295 Jul 11 14:17:18.763170 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 207/401] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:18 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1654 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:18.779434 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-96b71414-549a-423e-9cb9-e6ff8e983f36 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:18.785379 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-96b71414-549a-423e-9cb9-e6ff8e983f36 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:18.785828 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-96b71414-549a-423e-9cb9-e6ff8e983f36 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:18.808787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-96b71414-549a-423e-9cb9-e6ff8e983f36 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Going to try to start instance {{(pid=117921) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 11 14:17:18.850893 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-96b71414-549a-423e-9cb9-e6ff8e983f36 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "POST /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27/action" status: 202 len: 0 microversion: 2.1 time: 0.075014 Jul 11 14:17:18.851624 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 195/402] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 11 14:17:18 2022] POST /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:17:18.860904 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2146e572-3ac1-4247-85fb-493822913bce tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:18.861983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2146e572-3ac1-4247-85fb-493822913bce tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:18.868442 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2146e572-3ac1-4247-85fb-493822913bce tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:18.868919 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2146e572-3ac1-4247-85fb-493822913bce tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:18.869982 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2146e572-3ac1-4247-85fb-493822913bce tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:18.871604 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2146e572-3ac1-4247-85fb-493822913bce tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:19.056846 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2146e572-3ac1-4247-85fb-493822913bce tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:19.064772 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2146e572-3ac1-4247-85fb-493822913bce tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1663 microversion: 2.1 time: 0.208197 Jul 11 14:17:19.065364 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 208/403] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:18 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1663 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:19.752472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-409c6943-ee86-4b18-9854-f1756ea01668 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:19.753185 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-409c6943-ee86-4b18-9854-f1756ea01668 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:19.760124 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-409c6943-ee86-4b18-9854-f1756ea01668 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:19.760982 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-409c6943-ee86-4b18-9854-f1756ea01668 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:19.761763 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-409c6943-ee86-4b18-9854-f1756ea01668 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:19.762234 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-409c6943-ee86-4b18-9854-f1756ea01668 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:19.895752 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-409c6943-ee86-4b18-9854-f1756ea01668 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:19.904549 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-409c6943-ee86-4b18-9854-f1756ea01668 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1736 microversion: 2.1 time: 0.156631 Jul 11 14:17:19.905135 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 196/404] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:19 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:20.082321 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3dbf9cc3-5203-4959-b1ed-b80b00492d03 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:20.083091 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3dbf9cc3-5203-4959-b1ed-b80b00492d03 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:20.091223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3dbf9cc3-5203-4959-b1ed-b80b00492d03 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:20.091666 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3dbf9cc3-5203-4959-b1ed-b80b00492d03 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:20.093204 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3dbf9cc3-5203-4959-b1ed-b80b00492d03 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:20.093756 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3dbf9cc3-5203-4959-b1ed-b80b00492d03 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:20.236076 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3dbf9cc3-5203-4959-b1ed-b80b00492d03 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:20.244232 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3dbf9cc3-5203-4959-b1ed-b80b00492d03 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1663 microversion: 2.1 time: 0.165822 Jul 11 14:17:20.244873 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 209/405] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:20 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:20.923069 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3d6e0df6-4418-4fac-8922-eecb5a27e845 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:20.923683 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3d6e0df6-4418-4fac-8922-eecb5a27e845 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:20.930182 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d6e0df6-4418-4fac-8922-eecb5a27e845 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:20.930632 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d6e0df6-4418-4fac-8922-eecb5a27e845 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:20.931401 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d6e0df6-4418-4fac-8922-eecb5a27e845 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:20.931840 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d6e0df6-4418-4fac-8922-eecb5a27e845 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:21.065019 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3d6e0df6-4418-4fac-8922-eecb5a27e845 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:21.073149 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3d6e0df6-4418-4fac-8922-eecb5a27e845 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1736 microversion: 2.1 time: 0.153958 Jul 11 14:17:21.073717 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 197/406] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:20 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:21.262282 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4a7234fd-b238-43d1-be9b-5fa5416f3d3e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:21.262997 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4a7234fd-b238-43d1-be9b-5fa5416f3d3e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:21.269229 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4a7234fd-b238-43d1-be9b-5fa5416f3d3e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:21.269672 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4a7234fd-b238-43d1-be9b-5fa5416f3d3e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:21.270480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4a7234fd-b238-43d1-be9b-5fa5416f3d3e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:21.270912 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4a7234fd-b238-43d1-be9b-5fa5416f3d3e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:21.407059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4a7234fd-b238-43d1-be9b-5fa5416f3d3e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:21.414796 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4a7234fd-b238-43d1-be9b-5fa5416f3d3e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1667 microversion: 2.1 time: 0.156694 Jul 11 14:17:21.415387 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 210/407] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:21 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:22.090309 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ff33bd40-a6e3-4a97-bfe9-5fd075344fdb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:22.090926 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ff33bd40-a6e3-4a97-bfe9-5fd075344fdb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:22.097548 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff33bd40-a6e3-4a97-bfe9-5fd075344fdb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:22.098005 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff33bd40-a6e3-4a97-bfe9-5fd075344fdb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:22.098948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff33bd40-a6e3-4a97-bfe9-5fd075344fdb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:22.099387 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff33bd40-a6e3-4a97-bfe9-5fd075344fdb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:22.234004 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ff33bd40-a6e3-4a97-bfe9-5fd075344fdb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:22.242114 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ff33bd40-a6e3-4a97-bfe9-5fd075344fdb tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1736 microversion: 2.1 time: 0.155728 Jul 11 14:17:22.242708 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 198/408] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:22 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:23.261964 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9883c002-f745-4ad4-ae66-ac95c739cc70 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:23.263040 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9883c002-f745-4ad4-ae66-ac95c739cc70 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:23.270596 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9883c002-f745-4ad4-ae66-ac95c739cc70 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:23.271058 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9883c002-f745-4ad4-ae66-ac95c739cc70 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:23.271835 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9883c002-f745-4ad4-ae66-ac95c739cc70 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:23.272278 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9883c002-f745-4ad4-ae66-ac95c739cc70 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:23.417209 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9883c002-f745-4ad4-ae66-ac95c739cc70 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:23.421531 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:23.427011 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9883c002-f745-4ad4-ae66-ac95c739cc70 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1736 microversion: 2.1 time: 0.170642 Jul 11 14:17:23.427811 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 211/409] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:23 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:24.446659 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5e515aa2-bc1b-408e-8248-4cf3fd50cb3f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:24.447394 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5e515aa2-bc1b-408e-8248-4cf3fd50cb3f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:24.456317 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e515aa2-bc1b-408e-8248-4cf3fd50cb3f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:24.456771 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e515aa2-bc1b-408e-8248-4cf3fd50cb3f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:24.457547 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e515aa2-bc1b-408e-8248-4cf3fd50cb3f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:24.458012 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e515aa2-bc1b-408e-8248-4cf3fd50cb3f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:24.688599 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5e515aa2-bc1b-408e-8248-4cf3fd50cb3f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:24.697361 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5e515aa2-bc1b-408e-8248-4cf3fd50cb3f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1736 microversion: 2.1 time: 0.255523 Jul 11 14:17:24.697923 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 199/410] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:24 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1736 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:25.715083 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d6083bf0-6696-4c50-b75a-05efc05ec6de tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:25.715701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d6083bf0-6696-4c50-b75a-05efc05ec6de tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:25.723525 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6083bf0-6696-4c50-b75a-05efc05ec6de tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:25.723977 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6083bf0-6696-4c50-b75a-05efc05ec6de tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:25.724741 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6083bf0-6696-4c50-b75a-05efc05ec6de tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:25.725172 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6083bf0-6696-4c50-b75a-05efc05ec6de tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:25.864454 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d6083bf0-6696-4c50-b75a-05efc05ec6de tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:25.874846 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d6083bf0-6696-4c50-b75a-05efc05ec6de tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1736 microversion: 2.1 time: 0.163634 Jul 11 14:17:25.875883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 212/411] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:25 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:17:26.346698 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7b364757-f143-4422-a09b-38bb1118e939 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1894637085", "imageRef": "67874ac7-fac8-4d6d-9cd1-9091ecb957b6", "flavorRef": "452", "networks": [{"uuid": "63ab0621-ba7a-4083-966a-ad0e83277490"}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:26.397664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-7b364757-f143-4422-a09b-38bb1118e939 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] validate_networks() for [('63ab0621-ba7a-4083-966a-ad0e83277490', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:17:26.749711 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-7b364757-f143-4422-a09b-38bb1118e939 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:17:26.750131 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-7b364757-f143-4422-a09b-38bb1118e939 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:17:26.750624 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-7b364757-f143-4422-a09b-38bb1118e939 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:17:26.751030 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-7b364757-f143-4422-a09b-38bb1118e939 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:17:26.751496 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-7b364757-f143-4422-a09b-38bb1118e939 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:17:26.761412 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7b364757-f143-4422-a09b-38bb1118e939 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:26.761763 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7b364757-f143-4422-a09b-38bb1118e939 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:26.762635 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7b364757-f143-4422-a09b-38bb1118e939 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:26.763068 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7b364757-f143-4422-a09b-38bb1118e939 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:26.779671 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-7b364757-f143-4422-a09b-38bb1118e939 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Getting quotas for project 85f9647b786a44948b284da50555b62f. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:17:26.783602 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-7b364757-f143-4422-a09b-38bb1118e939 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Getting quotas for user ade7dda2cc0a49beb162804d36977079 and project 85f9647b786a44948b284da50555b62f. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:17:26.795111 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7b364757-f143-4422-a09b-38bb1118e939 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:17:26.797345 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7b364757-f143-4422-a09b-38bb1118e939 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67874ac7-fac8-4d6d-9cd1-9091ecb957b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:17:26.845796 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7b364757-f143-4422-a09b-38bb1118e939 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502823 Jul 11 14:17:26.851540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 200/412] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:17:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:17:26.858302 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-af265245-ae75-45e1-8c06-874206caea7a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:26.859257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-af265245-ae75-45e1-8c06-874206caea7a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:26.892758 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-62ddda7c-ef44-4fc0-83a9-62dc0835458d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:26.893391 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-62ddda7c-ef44-4fc0-83a9-62dc0835458d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:26.900472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-62ddda7c-ef44-4fc0-83a9-62dc0835458d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:26.900957 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-62ddda7c-ef44-4fc0-83a9-62dc0835458d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:26.901926 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-62ddda7c-ef44-4fc0-83a9-62dc0835458d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:26.902399 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-62ddda7c-ef44-4fc0-83a9-62dc0835458d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:26.914821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-af265245-ae75-45e1-8c06-874206caea7a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:26.924515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-af265245-ae75-45e1-8c06-874206caea7a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae" status: 200 len: 1219 microversion: 2.1 time: 0.071302 Jul 11 14:17:26.928457 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 213/413] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:26 2022] GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:27.043432 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-62ddda7c-ef44-4fc0-83a9-62dc0835458d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:27.051690 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-62ddda7c-ef44-4fc0-83a9-62dc0835458d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1716 microversion: 2.1 time: 0.162762 Jul 11 14:17:27.052504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 201/414] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:26 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1716 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:17:27.165535 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c6a1aebd-5df8-4b29-b339-6b6d3324754f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:27.166045 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c6a1aebd-5df8-4b29-b339-6b6d3324754f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:27.172168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6a1aebd-5df8-4b29-b339-6b6d3324754f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:27.172617 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6a1aebd-5df8-4b29-b339-6b6d3324754f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:27.173401 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6a1aebd-5df8-4b29-b339-6b6d3324754f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:27.173842 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6a1aebd-5df8-4b29-b339-6b6d3324754f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:27.261853 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-c6a1aebd-5df8-4b29-b339-6b6d3324754f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] HTTP exception thrown: Cannot 'detach_volume' instance 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 while it is in vm_state rescued Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c6a1aebd-5df8-4b29-b339-6b6d3324754f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Request method failure captured: Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-volume_attachments/94ff885c-de3b-4af9-a1d5-0792f8fac37a HTTP/1.1 Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDACP6mdhrBbHb9S3XX22Eb0vYXjhp1e_LptzxBkzLwvBvJ1-7gB1TqSdpdJ5YeHgf2tmnMDlqCnoElwnEKtizDSMd2V06J3G6UnMcuGg7PNEVrEt6Rrsspv6l6ei_5BXqbOVaeGYCCinqLdi82bSV7C8J2_OU2nV_ohEovCqh80m6I Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 15d95b0cae244d99885be229335ea541 Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1246670355 Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:17:27.263600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:17:27.265134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15d95b0cae244d99885be229335ea541"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15d95b0cae244d99885be229335ea541"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15d95b0cae244d99885be229335ea541"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15d95b0cae244d99885be229335ea541"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:17:27.265134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1246670355 Jul 11 14:17:27.265134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 15d95b0cae244d99885be229335ea541 Jul 11 14:17:27.265134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1246670355 Jul 11 14:17:27.265134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-ServerRescueNegativeTestJSON-1246670355-project Jul 11 14:17:27.265134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:17:27.265134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:17:27.265134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 39a5cea0a591453581a9d98ff796d973 Jul 11 14:17:27.265134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1246670355-project Jul 11 14:17:27.265134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:17:27.265134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Cannot 'detach_volume' instance 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 while it is in vm_state rescued Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'server_id': '413449f2-c97f-4bb8-a3c8-e8447fe3d1a8', 'id': '94ff885c-de3b-4af9-a1d5-0792f8fac37a'} Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:27.269292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:27.271223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 11 14:17:27.271223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 11 14:17:27.271223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 11 14:17:27.271223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 11 14:17:27.271223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 while it is in vm_state rescued Jul 11 14:17:27.271223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:17:27.271223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:27.271223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:17:27.271223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:27.271223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:27.271223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:27.271223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:27.271223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:27.271223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 while it is in vm_state rescued Jul 11 14:17:27.271223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:17:27.271223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c6a1aebd-5df8-4b29-b339-6b6d3324754f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Returning 409 to user: Cannot 'detach_volume' instance 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 while it is in vm_state rescued {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:27.272764 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c6a1aebd-5df8-4b29-b339-6b6d3324754f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "DELETE /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-volume_attachments/94ff885c-de3b-4af9-a1d5-0792f8fac37a" status: 409 len: 152 microversion: 2.1 time: 0.103509 Jul 11 14:17:27.272764 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 214/415] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 11 14:17:27 2022] DELETE /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-volume_attachments/94ff885c-de3b-4af9-a1d5-0792f8fac37a => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 11 14:17:27.274308 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0f961f67-e396-475b-aea1-99f9690ab564 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:27.274874 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0f961f67-e396-475b-aea1-99f9690ab564 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:27.281199 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f961f67-e396-475b-aea1-99f9690ab564 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:27.281640 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f961f67-e396-475b-aea1-99f9690ab564 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:27.282429 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f961f67-e396-475b-aea1-99f9690ab564 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:27.282863 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f961f67-e396-475b-aea1-99f9690ab564 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:27.354708 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0f961f67-e396-475b-aea1-99f9690ab564 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "POST /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/action" status: 202 len: 0 microversion: 2.1 time: 0.084101 Jul 11 14:17:27.358605 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 202/416] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 11 14:17:27 2022] POST /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:17:27.364862 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-74977e84-e38d-4d9f-bcbb-cc4df357f353 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:27.365610 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-74977e84-e38d-4d9f-bcbb-cc4df357f353 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:27.375725 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74977e84-e38d-4d9f-bcbb-cc4df357f353 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:27.377537 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74977e84-e38d-4d9f-bcbb-cc4df357f353 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:27.378363 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74977e84-e38d-4d9f-bcbb-cc4df357f353 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:27.378877 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74977e84-e38d-4d9f-bcbb-cc4df357f353 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:27.630450 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-74977e84-e38d-4d9f-bcbb-cc4df357f353 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:27.639130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-74977e84-e38d-4d9f-bcbb-cc4df357f353 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1724 microversion: 2.1 time: 0.279052 Jul 11 14:17:27.639727 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 215/417] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:27 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:27.944549 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e2c4c88d-5e31-4d94-924f-91de00f57646 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:27.945415 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e2c4c88d-5e31-4d94-924f-91de00f57646 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:27.952439 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e2c4c88d-5e31-4d94-924f-91de00f57646 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:27.953199 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e2c4c88d-5e31-4d94-924f-91de00f57646 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:27.954016 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e2c4c88d-5e31-4d94-924f-91de00f57646 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:27.955001 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e2c4c88d-5e31-4d94-924f-91de00f57646 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:28.032845 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e2c4c88d-5e31-4d94-924f-91de00f57646 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:28.040924 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e2c4c88d-5e31-4d94-924f-91de00f57646 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae" status: 200 len: 1279 microversion: 2.1 time: 0.101314 Jul 11 14:17:28.043191 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 203/418] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:27 2022] GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae => generated 1279 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:28.657002 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-58fefa84-78d3-45d5-8f41-c8e0e29e05e0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:28.657797 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-58fefa84-78d3-45d5-8f41-c8e0e29e05e0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:28.668795 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58fefa84-78d3-45d5-8f41-c8e0e29e05e0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:28.669434 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58fefa84-78d3-45d5-8f41-c8e0e29e05e0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:28.670349 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58fefa84-78d3-45d5-8f41-c8e0e29e05e0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:28.670958 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58fefa84-78d3-45d5-8f41-c8e0e29e05e0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:28.893057 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-58fefa84-78d3-45d5-8f41-c8e0e29e05e0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:28.901119 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-58fefa84-78d3-45d5-8f41-c8e0e29e05e0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1724 microversion: 2.1 time: 0.248106 Jul 11 14:17:28.901794 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 216/419] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:28 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:29.058991 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5b1e10e1-bbf9-42be-9a9a-992f72efe644 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:29.059623 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5b1e10e1-bbf9-42be-9a9a-992f72efe644 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:29.062082 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:29.068248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b1e10e1-bbf9-42be-9a9a-992f72efe644 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:29.068422 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b1e10e1-bbf9-42be-9a9a-992f72efe644 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:29.069127 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b1e10e1-bbf9-42be-9a9a-992f72efe644 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:29.069563 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b1e10e1-bbf9-42be-9a9a-992f72efe644 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:29.200155 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5b1e10e1-bbf9-42be-9a9a-992f72efe644 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:29.207679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5b1e10e1-bbf9-42be-9a9a-992f72efe644 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae" status: 200 len: 1319 microversion: 2.1 time: 0.153338 Jul 11 14:17:29.208248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 204/420] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:29 2022] GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:29.918938 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-00bfe5a6-e98c-449c-957c-656c4a386596 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:29.919561 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-00bfe5a6-e98c-449c-957c-656c4a386596 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:29.926360 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00bfe5a6-e98c-449c-957c-656c4a386596 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:29.926816 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00bfe5a6-e98c-449c-957c-656c4a386596 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:29.927589 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00bfe5a6-e98c-449c-957c-656c4a386596 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:29.928027 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00bfe5a6-e98c-449c-957c-656c4a386596 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:30.224930 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7ffa8cbd-9741-40c7-9924-8e1ccacf7ea6 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:30.225558 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7ffa8cbd-9741-40c7-9924-8e1ccacf7ea6 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:30.233342 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ffa8cbd-9741-40c7-9924-8e1ccacf7ea6 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:30.233794 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ffa8cbd-9741-40c7-9924-8e1ccacf7ea6 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:30.234629 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ffa8cbd-9741-40c7-9924-8e1ccacf7ea6 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:30.235073 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ffa8cbd-9741-40c7-9924-8e1ccacf7ea6 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:30.361205 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-00bfe5a6-e98c-449c-957c-656c4a386596 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:30.370605 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-00bfe5a6-e98c-449c-957c-656c4a386596 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1724 microversion: 2.1 time: 0.455772 Jul 11 14:17:30.371289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 217/421] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:29 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1724 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:17:30.382805 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7ffa8cbd-9741-40c7-9924-8e1ccacf7ea6 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:30.390123 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7ffa8cbd-9741-40c7-9924-8e1ccacf7ea6 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae" status: 200 len: 1319 microversion: 2.1 time: 0.169089 Jul 11 14:17:30.390737 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 205/422] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:30 2022] GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:17:30.909880 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-1614f5e1-9d7c-4fc4-8bc1-560b7617f288 req-7bffde8a-aec4-41c7-ad08-18f80b9a4a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "506dfd77-942c-437e-8f6f-fba1a71c48ae", "tag": "f73a5b2f-9545-4615-8beb-4e5b67809168"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:30.921900 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1614f5e1-9d7c-4fc4-8bc1-560b7617f288 req-7bffde8a-aec4-41c7-ad08-18f80b9a4a05 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:30.922578 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1614f5e1-9d7c-4fc4-8bc1-560b7617f288 req-7bffde8a-aec4-41c7-ad08-18f80b9a4a05 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:30.936263 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-1614f5e1-9d7c-4fc4-8bc1-560b7617f288 req-7bffde8a-aec4-41c7-ad08-18f80b9a4a05 service nova] Creating event network-changed:f73a5b2f-9545-4615-8beb-4e5b67809168 for instance 506dfd77-942c-437e-8f6f-fba1a71c48ae on hv-cinder-81914 Jul 11 14:17:30.941345 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-1614f5e1-9d7c-4fc4-8bc1-560b7617f288 req-7bffde8a-aec4-41c7-ad08-18f80b9a4a05 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036092 Jul 11 14:17:30.942171 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 218/423] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:17:31.387703 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-35e0a795-7710-46d5-b8bc-6648aa522b53 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:31.388356 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-35e0a795-7710-46d5-b8bc-6648aa522b53 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:31.394965 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-35e0a795-7710-46d5-b8bc-6648aa522b53 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:31.395419 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-35e0a795-7710-46d5-b8bc-6648aa522b53 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:31.396190 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-35e0a795-7710-46d5-b8bc-6648aa522b53 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:31.396631 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-35e0a795-7710-46d5-b8bc-6648aa522b53 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:31.407592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a0dfac79-3179-4ccc-8844-387ab62104aa tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:31.408298 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a0dfac79-3179-4ccc-8844-387ab62104aa tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:31.414624 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0dfac79-3179-4ccc-8844-387ab62104aa tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:31.415268 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0dfac79-3179-4ccc-8844-387ab62104aa tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:31.416036 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0dfac79-3179-4ccc-8844-387ab62104aa tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:31.416471 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0dfac79-3179-4ccc-8844-387ab62104aa tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:31.530586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-35e0a795-7710-46d5-b8bc-6648aa522b53 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:31.538760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-35e0a795-7710-46d5-b8bc-6648aa522b53 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1730 microversion: 2.1 time: 0.154908 Jul 11 14:17:31.539339 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 206/424] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:31 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:31.552696 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a0dfac79-3179-4ccc-8844-387ab62104aa tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:31.555867 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7afb3340-b686-4844-8ae7-594685854db2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:31.556393 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7afb3340-b686-4844-8ae7-594685854db2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:31.562758 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a0dfac79-3179-4ccc-8844-387ab62104aa tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae" status: 200 len: 1319 microversion: 2.1 time: 0.159452 Jul 11 14:17:31.563626 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 219/425] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:31 2022] GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:17:31.563743 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7afb3340-b686-4844-8ae7-594685854db2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:31.563993 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7afb3340-b686-4844-8ae7-594685854db2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:31.564764 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7afb3340-b686-4844-8ae7-594685854db2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:31.565223 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7afb3340-b686-4844-8ae7-594685854db2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:31.644832 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7afb3340-b686-4844-8ae7-594685854db2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092734 Jul 11 14:17:31.645432 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 207/426] 10.222.0.66 () {58 vars in 1274 bytes} [Mon Jul 11 14:17:31 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:17:32.569542 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-d3103727-3321-4ecd-8cef-230f6523b41f req-90050930-120d-4695-8385-535f4a30b3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "413449f2-c97f-4bb8-a3c8-e8447fe3d1a8", "tag": "8bfd8a36-2339-4c5c-9836-b9d0b3694f20"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:32.584224 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d611ee2b-0e1f-456c-9ea6-fecc774ecf56 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:32.584943 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d611ee2b-0e1f-456c-9ea6-fecc774ecf56 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:32.587821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d3103727-3321-4ecd-8cef-230f6523b41f req-90050930-120d-4695-8385-535f4a30b3a1 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:32.588586 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d3103727-3321-4ecd-8cef-230f6523b41f req-90050930-120d-4695-8385-535f4a30b3a1 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:32.594358 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d611ee2b-0e1f-456c-9ea6-fecc774ecf56 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:32.594910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d611ee2b-0e1f-456c-9ea6-fecc774ecf56 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:32.595940 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d611ee2b-0e1f-456c-9ea6-fecc774ecf56 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:32.596463 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d611ee2b-0e1f-456c-9ea6-fecc774ecf56 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:32.602179 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-d3103727-3321-4ecd-8cef-230f6523b41f req-90050930-120d-4695-8385-535f4a30b3a1 service nova] Creating event network-changed:8bfd8a36-2339-4c5c-9836-b9d0b3694f20 for instance 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 on hv-cinder-81914 Jul 11 14:17:32.608153 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-d3103727-3321-4ecd-8cef-230f6523b41f req-90050930-120d-4695-8385-535f4a30b3a1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042367 Jul 11 14:17:32.609093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 220/427] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:17:32.738511 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d611ee2b-0e1f-456c-9ea6-fecc774ecf56 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:32.749485 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d611ee2b-0e1f-456c-9ea6-fecc774ecf56 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae" status: 200 len: 1319 microversion: 2.1 time: 0.173096 Jul 11 14:17:32.750125 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 208/428] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:32 2022] GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:17:33.770781 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bdc53b1f-311d-453a-acc0-937e2068404f tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:33.771406 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bdc53b1f-311d-453a-acc0-937e2068404f tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:33.773391 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=53 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:33.779654 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bdc53b1f-311d-453a-acc0-937e2068404f tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:33.780226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bdc53b1f-311d-453a-acc0-937e2068404f tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:33.781005 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bdc53b1f-311d-453a-acc0-937e2068404f tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:33.781443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bdc53b1f-311d-453a-acc0-937e2068404f tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:33.912179 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bdc53b1f-311d-453a-acc0-937e2068404f tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:33.921284 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bdc53b1f-311d-453a-acc0-937e2068404f tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae" status: 200 len: 1319 microversion: 2.1 time: 0.155497 Jul 11 14:17:33.921861 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 221/429] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:33 2022] GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:34.624616 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-0b7a82b1-6dc9-4b45-a7df-ff85708e40e7 req-df3e8002-5077-4a22-883a-fcb00f19eb68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "413449f2-c97f-4bb8-a3c8-e8447fe3d1a8", "tag": "8bfd8a36-2339-4c5c-9836-b9d0b3694f20"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:34.633411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-0b7a82b1-6dc9-4b45-a7df-ff85708e40e7 req-df3e8002-5077-4a22-883a-fcb00f19eb68 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:34.633871 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-0b7a82b1-6dc9-4b45-a7df-ff85708e40e7 req-df3e8002-5077-4a22-883a-fcb00f19eb68 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:34.645470 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-0b7a82b1-6dc9-4b45-a7df-ff85708e40e7 req-df3e8002-5077-4a22-883a-fcb00f19eb68 service nova] Creating event network-changed:8bfd8a36-2339-4c5c-9836-b9d0b3694f20 for instance 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 on hv-cinder-81914 Jul 11 14:17:34.650388 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-0b7a82b1-6dc9-4b45-a7df-ff85708e40e7 req-df3e8002-5077-4a22-883a-fcb00f19eb68 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029891 Jul 11 14:17:34.650983 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 209/430] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:17:34.937670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bc6ef433-94d1-48f7-89be-c249aa8cc7e7 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:34.938328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bc6ef433-94d1-48f7-89be-c249aa8cc7e7 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:34.944971 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc6ef433-94d1-48f7-89be-c249aa8cc7e7 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:34.945499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc6ef433-94d1-48f7-89be-c249aa8cc7e7 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:34.946376 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc6ef433-94d1-48f7-89be-c249aa8cc7e7 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:34.946818 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc6ef433-94d1-48f7-89be-c249aa8cc7e7 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:35.162423 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bc6ef433-94d1-48f7-89be-c249aa8cc7e7 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:35.170515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bc6ef433-94d1-48f7-89be-c249aa8cc7e7 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae" status: 200 len: 1319 microversion: 2.1 time: 0.236610 Jul 11 14:17:35.171097 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 222/431] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:34 2022] GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:36.188702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-12bf7259-e9eb-42fd-ad37-f6d2d44d8883 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:36.189403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-12bf7259-e9eb-42fd-ad37-f6d2d44d8883 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:36.195562 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-12bf7259-e9eb-42fd-ad37-f6d2d44d8883 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:36.196000 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-12bf7259-e9eb-42fd-ad37-f6d2d44d8883 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:36.196786 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-12bf7259-e9eb-42fd-ad37-f6d2d44d8883 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:36.197213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-12bf7259-e9eb-42fd-ad37-f6d2d44d8883 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:36.218655 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:36.334972 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-12bf7259-e9eb-42fd-ad37-f6d2d44d8883 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:36.343131 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-12bf7259-e9eb-42fd-ad37-f6d2d44d8883 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae" status: 200 len: 1319 microversion: 2.1 time: 0.159013 Jul 11 14:17:36.343873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 210/432] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:36 2022] GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:36.851769 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-fad0a362-a664-44b9-b2d8-b8c6b21ac903 req-8ee8aca6-0eaa-462c-bbab-940e2759af5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "506dfd77-942c-437e-8f6f-fba1a71c48ae", "name": "network-vif-plugged", "status": "completed", "tag": "f73a5b2f-9545-4615-8beb-4e5b67809168"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:36.862377 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-fad0a362-a664-44b9-b2d8-b8c6b21ac903 req-8ee8aca6-0eaa-462c-bbab-940e2759af5e service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:36.862822 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-fad0a362-a664-44b9-b2d8-b8c6b21ac903 req-8ee8aca6-0eaa-462c-bbab-940e2759af5e service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:36.875363 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-fad0a362-a664-44b9-b2d8-b8c6b21ac903 req-8ee8aca6-0eaa-462c-bbab-940e2759af5e service nova] Creating event network-vif-plugged:f73a5b2f-9545-4615-8beb-4e5b67809168 for instance 506dfd77-942c-437e-8f6f-fba1a71c48ae on hv-cinder-81914 Jul 11 14:17:36.880385 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-fad0a362-a664-44b9-b2d8-b8c6b21ac903 req-8ee8aca6-0eaa-462c-bbab-940e2759af5e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032610 Jul 11 14:17:36.881004 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 223/433] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:17:37.360874 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-02b3c528-b4bd-4789-8f0d-279de3f074c9 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:37.361485 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-02b3c528-b4bd-4789-8f0d-279de3f074c9 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:37.363366 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:37.364218 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:37.371099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-02b3c528-b4bd-4789-8f0d-279de3f074c9 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:37.371546 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-02b3c528-b4bd-4789-8f0d-279de3f074c9 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:37.372355 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-02b3c528-b4bd-4789-8f0d-279de3f074c9 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:37.372791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-02b3c528-b4bd-4789-8f0d-279de3f074c9 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:37.509506 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-02b3c528-b4bd-4789-8f0d-279de3f074c9 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:37.517038 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-02b3c528-b4bd-4789-8f0d-279de3f074c9 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae" status: 200 len: 1319 microversion: 2.1 time: 0.160027 Jul 11 14:17:37.517611 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 211/434] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:37 2022] GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:38.531050 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:38.535646 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2259cf23-0cac-40c4-b267-fc9f1b6abeae tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:38.536339 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2259cf23-0cac-40c4-b267-fc9f1b6abeae tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:38.542998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2259cf23-0cac-40c4-b267-fc9f1b6abeae tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:38.543446 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2259cf23-0cac-40c4-b267-fc9f1b6abeae tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:38.544204 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2259cf23-0cac-40c4-b267-fc9f1b6abeae tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:38.544631 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2259cf23-0cac-40c4-b267-fc9f1b6abeae tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:38.680978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2259cf23-0cac-40c4-b267-fc9f1b6abeae tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:38.688965 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2259cf23-0cac-40c4-b267-fc9f1b6abeae tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae" status: 200 len: 1319 microversion: 2.1 time: 0.158889 Jul 11 14:17:38.689535 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 224/435] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:38 2022] GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:39.705523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-97ee5802-be1a-4e7d-883e-4862b9d61020 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:39.706125 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-97ee5802-be1a-4e7d-883e-4862b9d61020 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:39.712655 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-97ee5802-be1a-4e7d-883e-4862b9d61020 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:39.713096 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-97ee5802-be1a-4e7d-883e-4862b9d61020 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:39.714499 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-97ee5802-be1a-4e7d-883e-4862b9d61020 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:39.714971 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-97ee5802-be1a-4e7d-883e-4862b9d61020 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:39.845545 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-97ee5802-be1a-4e7d-883e-4862b9d61020 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:39.853431 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-97ee5802-be1a-4e7d-883e-4862b9d61020 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae" status: 200 len: 1507 microversion: 2.1 time: 0.151641 Jul 11 14:17:39.853926 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 212/436] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:39 2022] GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:57.081140 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c1af0dc5-0c57-480a-815e-8a631e87d3ae tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05b5c8e0-787b-43ea-a6ca-f6b8abf3fd22", "device": "/dev/sdb"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:57.082905 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c1af0dc5-0c57-480a-815e-8a631e87d3ae tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:57.084891 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=7 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:57.085598 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=60 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:57.092603 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1af0dc5-0c57-480a-815e-8a631e87d3ae tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:57.093054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1af0dc5-0c57-480a-815e-8a631e87d3ae tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:57.093835 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1af0dc5-0c57-480a-815e-8a631e87d3ae tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:57.094306 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1af0dc5-0c57-480a-815e-8a631e87d3ae tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:57.347483 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c1af0dc5-0c57-480a-815e-8a631e87d3ae tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "POST /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270222 Jul 11 14:17:57.348132 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 225/437] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 11 14:17:57 2022] POST /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:18:04.524933 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f7a3686a-0a52-47a1-985e-1232ce06e268 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:04.526015 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f7a3686a-0a52-47a1-985e-1232ce06e268 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:04.528307 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=17 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:04.529041 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=14 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:04.536823 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7a3686a-0a52-47a1-985e-1232ce06e268 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:04.537260 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7a3686a-0a52-47a1-985e-1232ce06e268 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:04.538049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7a3686a-0a52-47a1-985e-1232ce06e268 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:04.538541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7a3686a-0a52-47a1-985e-1232ce06e268 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:04.575587 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f7a3686a-0a52-47a1-985e-1232ce06e268 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054960 Jul 11 14:18:04.576244 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 213/438] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:18:04 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 14:18:04.637743 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bffc8336-f186-4144-a13f-9f44fb3065dc tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:04.638365 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bffc8336-f186-4144-a13f-9f44fb3065dc tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:04.645489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bffc8336-f186-4144-a13f-9f44fb3065dc tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:04.645947 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bffc8336-f186-4144-a13f-9f44fb3065dc tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:04.647620 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bffc8336-f186-4144-a13f-9f44fb3065dc tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:04.648344 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bffc8336-f186-4144-a13f-9f44fb3065dc tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:04.677260 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bffc8336-f186-4144-a13f-9f44fb3065dc tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:18:04.755331 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bffc8336-f186-4144-a13f-9f44fb3065dc tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "DELETE /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 204 len: 0 microversion: 2.1 time: 0.121437 Jul 11 14:18:04.756059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 226/439] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:18:04 2022] DELETE /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:18:04.764773 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-03e3ffd1-f593-427d-95e3-502dd3142e2f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:04.765497 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-03e3ffd1-f593-427d-95e3-502dd3142e2f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:04.771682 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-03e3ffd1-f593-427d-95e3-502dd3142e2f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:04.772203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-03e3ffd1-f593-427d-95e3-502dd3142e2f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:04.773176 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-03e3ffd1-f593-427d-95e3-502dd3142e2f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:04.773698 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-03e3ffd1-f593-427d-95e3-502dd3142e2f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:04.915544 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-03e3ffd1-f593-427d-95e3-502dd3142e2f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:04.923617 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-03e3ffd1-f593-427d-95e3-502dd3142e2f tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1673 microversion: 2.1 time: 0.162954 Jul 11 14:18:04.924209 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 214/440] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:04 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:05.940781 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-68ebad57-b7d3-4a78-926b-61eb4585f779 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:05.941493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-68ebad57-b7d3-4a78-926b-61eb4585f779 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:05.948066 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68ebad57-b7d3-4a78-926b-61eb4585f779 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:05.948519 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68ebad57-b7d3-4a78-926b-61eb4585f779 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:05.949293 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68ebad57-b7d3-4a78-926b-61eb4585f779 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:05.949730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68ebad57-b7d3-4a78-926b-61eb4585f779 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:06.082900 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-68ebad57-b7d3-4a78-926b-61eb4585f779 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:06.090367 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-68ebad57-b7d3-4a78-926b-61eb4585f779 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1673 microversion: 2.1 time: 0.153824 Jul 11 14:18:06.091306 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 227/441] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:05 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:07.108666 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f1f76c83-abe4-49b7-a1f5-bdb299aa4b4c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:07.109273 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f1f76c83-abe4-49b7-a1f5-bdb299aa4b4c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:07.115947 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f1f76c83-abe4-49b7-a1f5-bdb299aa4b4c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:07.116391 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f1f76c83-abe4-49b7-a1f5-bdb299aa4b4c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:07.117151 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f1f76c83-abe4-49b7-a1f5-bdb299aa4b4c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:07.117581 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f1f76c83-abe4-49b7-a1f5-bdb299aa4b4c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:07.249513 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f1f76c83-abe4-49b7-a1f5-bdb299aa4b4c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:07.257284 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f1f76c83-abe4-49b7-a1f5-bdb299aa4b4c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1673 microversion: 2.1 time: 0.153303 Jul 11 14:18:07.257854 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 215/442] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:07 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:08.276090 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c017dfa8-9aaa-4a77-b8dd-610bf21173d3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:08.276735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c017dfa8-9aaa-4a77-b8dd-610bf21173d3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:08.283906 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c017dfa8-9aaa-4a77-b8dd-610bf21173d3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:08.284354 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c017dfa8-9aaa-4a77-b8dd-610bf21173d3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:08.285121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c017dfa8-9aaa-4a77-b8dd-610bf21173d3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:08.285560 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c017dfa8-9aaa-4a77-b8dd-610bf21173d3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:08.422506 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c017dfa8-9aaa-4a77-b8dd-610bf21173d3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:08.430229 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c017dfa8-9aaa-4a77-b8dd-610bf21173d3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1673 microversion: 2.1 time: 0.157950 Jul 11 14:18:08.430791 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 228/443] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:08 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:09.449074 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-99d9a89e-8c15-4960-b228-773d961725f3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:09.450404 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-99d9a89e-8c15-4960-b228-773d961725f3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:09.459730 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99d9a89e-8c15-4960-b228-773d961725f3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:09.460178 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99d9a89e-8c15-4960-b228-773d961725f3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:09.462676 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99d9a89e-8c15-4960-b228-773d961725f3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:09.463215 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99d9a89e-8c15-4960-b228-773d961725f3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:09.531179 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-99d9a89e-8c15-4960-b228-773d961725f3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:09.539459 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-99d9a89e-8c15-4960-b228-773d961725f3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1606 microversion: 2.1 time: 0.095753 Jul 11 14:18:09.540041 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 216/444] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:09 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1606 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:09.730969 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-97947d9e-ea62-4c74-b66b-2a65621e09dd req-255cc4e4-8689-47ea-bca2-1c6e2753d245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f5f00b-3f48-4d27-9330-2b61cfa19d27", "name": "network-vif-deleted", "tag": "0b6e7c6b-601e-412f-b987-a5b8f2bb58b7"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:09.741595 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-97947d9e-ea62-4c74-b66b-2a65621e09dd req-255cc4e4-8689-47ea-bca2-1c6e2753d245 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:09.742135 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-97947d9e-ea62-4c74-b66b-2a65621e09dd req-255cc4e4-8689-47ea-bca2-1c6e2753d245 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:09.754916 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-97947d9e-ea62-4c74-b66b-2a65621e09dd req-255cc4e4-8689-47ea-bca2-1c6e2753d245 service nova] Creating event network-vif-deleted:0b6e7c6b-601e-412f-b987-a5b8f2bb58b7 for instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 on hv-cinder-81914 Jul 11 14:18:09.759990 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-97947d9e-ea62-4c74-b66b-2a65621e09dd req-255cc4e4-8689-47ea-bca2-1c6e2753d245 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032547 Jul 11 14:18:09.760617 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 229/445] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:18:10.556891 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-66f8be10-89a9-4a38-bcf5-935125825705 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:10.557507 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-66f8be10-89a9-4a38-bcf5-935125825705 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:10.564197 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-66f8be10-89a9-4a38-bcf5-935125825705 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:10.564641 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-66f8be10-89a9-4a38-bcf5-935125825705 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:10.565410 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-66f8be10-89a9-4a38-bcf5-935125825705 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:10.565861 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-66f8be10-89a9-4a38-bcf5-935125825705 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:10.631860 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-66f8be10-89a9-4a38-bcf5-935125825705 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:10.639799 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-66f8be10-89a9-4a38-bcf5-935125825705 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1606 microversion: 2.1 time: 0.086781 Jul 11 14:18:10.642204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 217/446] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:10 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1606 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:11.658782 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f67d81a6-732b-45b0-8e72-b589acaacb82 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:11.659505 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f67d81a6-732b-45b0-8e72-b589acaacb82 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:11.666104 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f67d81a6-732b-45b0-8e72-b589acaacb82 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:11.666593 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f67d81a6-732b-45b0-8e72-b589acaacb82 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:11.667379 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f67d81a6-732b-45b0-8e72-b589acaacb82 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:11.667821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f67d81a6-732b-45b0-8e72-b589acaacb82 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:11.736218 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f67d81a6-732b-45b0-8e72-b589acaacb82 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:11.743868 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f67d81a6-732b-45b0-8e72-b589acaacb82 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1321 microversion: 2.1 time: 0.090673 Jul 11 14:18:11.744468 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 230/447] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:11 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1321 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:12.761537 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-60e71a77-f477-44cc-86a4-682aea961c43 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:12.762566 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-60e71a77-f477-44cc-86a4-682aea961c43 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:12.769885 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-60e71a77-f477-44cc-86a4-682aea961c43 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:12.770455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-60e71a77-f477-44cc-86a4-682aea961c43 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:12.771340 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-60e71a77-f477-44cc-86a4-682aea961c43 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:12.771933 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-60e71a77-f477-44cc-86a4-682aea961c43 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:12.811536 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-60e71a77-f477-44cc-86a4-682aea961c43 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:12.812071 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-60e71a77-f477-44cc-86a4-682aea961c43 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:12.812560 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-60e71a77-f477-44cc-86a4-682aea961c43 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lazy-loading 'fault' on Instance uuid 22f5f00b-3f48-4d27-9330-2b61cfa19d27 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:18:12.854054 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-60e71a77-f477-44cc-86a4-682aea961c43 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:12.862603 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-60e71a77-f477-44cc-86a4-682aea961c43 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 200 len: 1326 microversion: 2.1 time: 0.105138 Jul 11 14:18:12.863243 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 218/448] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:12 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:13.481418 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8dd009ea-767d-4546-b5dc-45f45ee5d436 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:13.482008 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8dd009ea-767d-4546-b5dc-45f45ee5d436 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:13.488594 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8dd009ea-767d-4546-b5dc-45f45ee5d436 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:13.489050 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8dd009ea-767d-4546-b5dc-45f45ee5d436 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:13.489829 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8dd009ea-767d-4546-b5dc-45f45ee5d436 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:13.490302 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8dd009ea-767d-4546-b5dc-45f45ee5d436 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:13.581792 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-8dd009ea-767d-4546-b5dc-45f45ee5d436 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lazy-loading 'services' on Instance uuid 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:18:13.659051 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8dd009ea-767d-4546-b5dc-45f45ee5d436 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "DELETE /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-volume_attachments/94ff885c-de3b-4af9-a1d5-0792f8fac37a" status: 202 len: 0 microversion: 2.1 time: 0.181237 Jul 11 14:18:13.659709 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 231/449] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 11 14:18:13 2022] DELETE /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-volume_attachments/94ff885c-de3b-4af9-a1d5-0792f8fac37a => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:18:13.668166 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e47ecc9c-527e-49b8-ad21-fbd07163adb0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:13.669148 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e47ecc9c-527e-49b8-ad21-fbd07163adb0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:13.675391 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e47ecc9c-527e-49b8-ad21-fbd07163adb0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:13.675825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e47ecc9c-527e-49b8-ad21-fbd07163adb0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:13.676590 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e47ecc9c-527e-49b8-ad21-fbd07163adb0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:13.677015 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e47ecc9c-527e-49b8-ad21-fbd07163adb0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:13.707700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e47ecc9c-527e-49b8-ad21-fbd07163adb0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043410 Jul 11 14:18:13.708264 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 219/450] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:18:13 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:18:13.880842 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-abeef77e-61eb-4ae4-bb0f-267ae6105b39 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:13.881563 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-abeef77e-61eb-4ae4-bb0f-267ae6105b39 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:13.887835 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-abeef77e-61eb-4ae4-bb0f-267ae6105b39 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:13.889120 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-abeef77e-61eb-4ae4-bb0f-267ae6105b39 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:13.889847 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-abeef77e-61eb-4ae4-bb0f-267ae6105b39 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:13.890304 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-abeef77e-61eb-4ae4-bb0f-267ae6105b39 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:13.903456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-abeef77e-61eb-4ae4-bb0f-267ae6105b39 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] HTTP exception thrown: Instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 could not be found. Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-abeef77e-61eb-4ae4-bb0f-267ae6105b39 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Request method failure captured: Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 HTTP/1.1 Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDAJb9-VMz4Plu27RutXvf7coBuJE9-_YeT6TXHgSen1kLNO-8F8GBA0OQXFu7DZw9K7jxhjI1AKEjzTyUd4pE7sfnbyawbzaawX9Yapp8I29NtVKARAvyVI4p0nFE2qLIAXouyt0DAk8y4OaI7AN88Jlu4tbHXEGxgkyNWBlwY5hAw Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 15ad9d19847049c18d3bdc9f6e6c5168 Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-1518326899 Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:18:13.905074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:18:13.906685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:18:13.906685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-1518326899 Jul 11 14:18:13.906685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 15ad9d19847049c18d3bdc9f6e6c5168 Jul 11 14:18:13.906685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1518326899 Jul 11 14:18:13.906685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-1518326899-project Jul 11 14:18:13.906685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:18:13.906685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:18:13.906685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 79023e778baa45888e6ef870499e5ad8 Jul 11 14:18:13.906685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-1518326899-project Jul 11 14:18:13.906685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:18:13.906685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 could not be found. Jul 11 14:18:13.906685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': '22f5f00b-3f48-4d27-9330-2b61cfa19d27'} Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 could not be found. Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:18:13.907641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:18:13.909203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:18:13.909203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:18:13.909203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:18:13.909203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:18:13.909203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:18:13.909203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:18:13.909203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:18:13.909203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 could not be found. Jul 11 14:18:13.909203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:18:13.909203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:18:13.909203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:18:13.909203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:18:13.909203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:18:13.909203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:18:13.909203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:18:13.909203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:18:13.909203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 could not be found. Jul 11 14:18:13.909203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:18:13.910544 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-abeef77e-61eb-4ae4-bb0f-267ae6105b39 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Returning 404 to user: Instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:18:13.910544 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-abeef77e-61eb-4ae4-bb0f-267ae6105b39 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 404 len: 111 microversion: 2.1 time: 0.030171 Jul 11 14:18:13.910544 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 232/451] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:13 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:18:13.915835 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f6782d4b-dcee-4aff-9b4c-afd14e1d81d7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '.version_select at 0x7fc976d88790>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:13.941919 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f6782d4b-dcee-4aff-9b4c-afd14e1d81d7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-664534556" status: 202 len: 0 microversion: 2.1 time: 0.029897 Jul 11 14:18:13.942546 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 220/452] 10.222.0.66 () {58 vars in 1217 bytes} [Mon Jul 11 14:18:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-664534556 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:18:14.719667 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7a1b4c04-593a-427d-99ae-dc19e9298462 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:14.720697 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7a1b4c04-593a-427d-99ae-dc19e9298462 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:14.727761 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a1b4c04-593a-427d-99ae-dc19e9298462 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:14.728288 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a1b4c04-593a-427d-99ae-dc19e9298462 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:14.729069 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a1b4c04-593a-427d-99ae-dc19e9298462 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:14.729500 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a1b4c04-593a-427d-99ae-dc19e9298462 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:14.760104 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7a1b4c04-593a-427d-99ae-dc19e9298462 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044958 Jul 11 14:18:14.760679 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 233/453] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:18:14 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:18:14.806882 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b677beb0-94e8-4c35-b9c3-db03516eb799 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Action: 'create', calling method: .version_select at 0x7fc976ca10d0>, body: {"keypair": {"name": "tempest-keypair-1094997154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkcSdb2EXKBZiy904OxC64WBoQLFsej2z5B/gcXTmlEw4fUGKMsrwdq99hVBHpmBupbnt3kClfDdrBHMMABscRUHZ6Lejt/QHoJTuaaAuT6yPQgt0Lb+nkYeGVM5Z5vqQ=="}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:14.821685 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-b677beb0-94e8-4c35-b9c3-db03516eb799 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Getting quotas for project 15ad9d19847049c18d3bdc9f6e6c5168. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:18:14.825607 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-b677beb0-94e8-4c35-b9c3-db03516eb799 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Getting quotas for user 79023e778baa45888e6ef870499e5ad8 and project 15ad9d19847049c18d3bdc9f6e6c5168. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:18:14.849458 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b677beb0-94e8-4c35-b9c3-db03516eb799 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046618 Jul 11 14:18:14.850063 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 221/454] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 11 14:18:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:18:15.772876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a6572183-4be1-4efa-8ec5-49b4bd48a955 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:15.773816 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a6572183-4be1-4efa-8ec5-49b4bd48a955 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:15.781424 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6572183-4be1-4efa-8ec5-49b4bd48a955 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:15.782190 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6572183-4be1-4efa-8ec5-49b4bd48a955 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:15.782942 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6572183-4be1-4efa-8ec5-49b4bd48a955 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:15.783390 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6572183-4be1-4efa-8ec5-49b4bd48a955 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:15.814631 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a6572183-4be1-4efa-8ec5-49b4bd48a955 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045694 Jul 11 14:18:15.815208 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 234/455] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:18:15 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:18:16.159091 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d1be68f7-4ed9-4a89-a293-f2d59532375e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1274345289", "imageRef": "67874ac7-fac8-4d6d-9cd1-9091ecb957b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "157161e1-a50b-44c4-82a7-27bca4094b73"}], "security_groups": [{"name": "tempest-securitygroup--69326018"}], "key_name": "tempest-keypair-1094997154", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:16.416466 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-d1be68f7-4ed9-4a89-a293-f2d59532375e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] validate_networks() for [('157161e1-a50b-44c4-82a7-27bca4094b73', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:18:16.828361 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1dfa81e6-1b48-4d1c-bd6a-ff07ee570d16 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:16.829649 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1dfa81e6-1b48-4d1c-bd6a-ff07ee570d16 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:16.836588 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dfa81e6-1b48-4d1c-bd6a-ff07ee570d16 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:16.837069 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dfa81e6-1b48-4d1c-bd6a-ff07ee570d16 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:16.837846 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dfa81e6-1b48-4d1c-bd6a-ff07ee570d16 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:16.838315 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dfa81e6-1b48-4d1c-bd6a-ff07ee570d16 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:16.877535 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1dfa81e6-1b48-4d1c-bd6a-ff07ee570d16 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053984 Jul 11 14:18:16.878071 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 235/456] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:18:16 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:18:17.063125 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-d1be68f7-4ed9-4a89-a293-f2d59532375e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:18:17.063548 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-d1be68f7-4ed9-4a89-a293-f2d59532375e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:18:17.064098 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-d1be68f7-4ed9-4a89-a293-f2d59532375e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:18:17.064461 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-d1be68f7-4ed9-4a89-a293-f2d59532375e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:18:17.064879 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-d1be68f7-4ed9-4a89-a293-f2d59532375e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:18:17.073872 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1be68f7-4ed9-4a89-a293-f2d59532375e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:17.074459 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1be68f7-4ed9-4a89-a293-f2d59532375e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:17.075230 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1be68f7-4ed9-4a89-a293-f2d59532375e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:17.075634 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1be68f7-4ed9-4a89-a293-f2d59532375e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:17.097540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-d1be68f7-4ed9-4a89-a293-f2d59532375e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Getting quotas for project 15ad9d19847049c18d3bdc9f6e6c5168. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:18:17.101555 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-d1be68f7-4ed9-4a89-a293-f2d59532375e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Getting quotas for user 79023e778baa45888e6ef870499e5ad8 and project 15ad9d19847049c18d3bdc9f6e6c5168. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:18:17.114341 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d1be68f7-4ed9-4a89-a293-f2d59532375e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:18:17.116748 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d1be68f7-4ed9-4a89-a293-f2d59532375e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67874ac7-fac8-4d6d-9cd1-9091ecb957b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:18:17.167565 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d1be68f7-4ed9-4a89-a293-f2d59532375e tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.014014 Jul 11 14:18:17.168544 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 222/457] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:18:16 2022] POST /compute/v2.1/servers => generated 400 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:18:17.180872 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-22fa6511-3948-47d0-b0ca-2c462aab6a9b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:17.181674 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-22fa6511-3948-47d0-b0ca-2c462aab6a9b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:17.247378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-22fa6511-3948-47d0-b0ca-2c462aab6a9b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:17.256224 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-22fa6511-3948-47d0-b0ca-2c462aab6a9b tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1238 microversion: 2.1 time: 0.080882 Jul 11 14:18:17.266200 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 236/458] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:17 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:17.891405 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fa6b1658-588a-4fa1-9fd4-40f3e4efe085 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:17.892588 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fa6b1658-588a-4fa1-9fd4-40f3e4efe085 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:17.899517 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa6b1658-588a-4fa1-9fd4-40f3e4efe085 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:17.900296 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa6b1658-588a-4fa1-9fd4-40f3e4efe085 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:17.901086 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa6b1658-588a-4fa1-9fd4-40f3e4efe085 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:17.901532 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa6b1658-588a-4fa1-9fd4-40f3e4efe085 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:17.931923 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fa6b1658-588a-4fa1-9fd4-40f3e4efe085 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046505 Jul 11 14:18:17.932491 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 223/459] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:18:17 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 14:18:18.007412 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ef9c12b8-ddab-4267-8314-ad29213e66c0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:18.007977 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ef9c12b8-ddab-4267-8314-ad29213e66c0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:18.015438 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef9c12b8-ddab-4267-8314-ad29213e66c0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:18.015881 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef9c12b8-ddab-4267-8314-ad29213e66c0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:18.016655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef9c12b8-ddab-4267-8314-ad29213e66c0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:18.017088 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef9c12b8-ddab-4267-8314-ad29213e66c0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:18.045095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ef9c12b8-ddab-4267-8314-ad29213e66c0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:18:18.125756 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ef9c12b8-ddab-4267-8314-ad29213e66c0 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "DELETE /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 204 len: 0 microversion: 2.1 time: 0.122263 Jul 11 14:18:18.126635 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 237/460] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:18:18 2022] DELETE /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:18:18.134585 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9952f9b4-0ae2-4443-975a-f567b5aab45f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:18.135202 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9952f9b4-0ae2-4443-975a-f567b5aab45f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:18.142180 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9952f9b4-0ae2-4443-975a-f567b5aab45f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:18.142665 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9952f9b4-0ae2-4443-975a-f567b5aab45f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:18.143487 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9952f9b4-0ae2-4443-975a-f567b5aab45f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:18.143922 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9952f9b4-0ae2-4443-975a-f567b5aab45f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:18.273645 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e5b8e060-622c-4873-ad96-c783ea95eff8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:18.275240 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e5b8e060-622c-4873-ad96-c783ea95eff8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:18.279902 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9952f9b4-0ae2-4443-975a-f567b5aab45f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:18.284385 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5b8e060-622c-4873-ad96-c783ea95eff8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:18.284843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5b8e060-622c-4873-ad96-c783ea95eff8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:18.285626 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5b8e060-622c-4873-ad96-c783ea95eff8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:18.286197 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5b8e060-622c-4873-ad96-c783ea95eff8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:18.290180 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9952f9b4-0ae2-4443-975a-f567b5aab45f tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1690 microversion: 2.1 time: 0.159374 Jul 11 14:18:18.290912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 224/461] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:18 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:18.304860 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:18.406846 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e5b8e060-622c-4873-ad96-c783ea95eff8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:18.415285 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e5b8e060-622c-4873-ad96-c783ea95eff8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1290 microversion: 2.1 time: 0.145857 Jul 11 14:18:18.415879 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 238/462] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:18 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1290 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:19.307811 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6e6c836a-5377-42c8-b47d-870ed380ac47 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:19.308432 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6e6c836a-5377-42c8-b47d-870ed380ac47 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:19.315163 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e6c836a-5377-42c8-b47d-870ed380ac47 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:19.315616 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e6c836a-5377-42c8-b47d-870ed380ac47 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:19.316386 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e6c836a-5377-42c8-b47d-870ed380ac47 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:19.316822 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e6c836a-5377-42c8-b47d-870ed380ac47 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:19.433546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b2e69423-6988-4bd0-9a53-0d21008f3a14 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:19.434284 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b2e69423-6988-4bd0-9a53-0d21008f3a14 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:19.440810 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2e69423-6988-4bd0-9a53-0d21008f3a14 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:19.441252 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2e69423-6988-4bd0-9a53-0d21008f3a14 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:19.442048 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2e69423-6988-4bd0-9a53-0d21008f3a14 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:19.442498 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2e69423-6988-4bd0-9a53-0d21008f3a14 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:19.446846 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6e6c836a-5377-42c8-b47d-870ed380ac47 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:19.454722 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6e6c836a-5377-42c8-b47d-870ed380ac47 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1690 microversion: 2.1 time: 0.150741 Jul 11 14:18:19.455298 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 225/463] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:19 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:19.507440 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b2e69423-6988-4bd0-9a53-0d21008f3a14 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:19.515847 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b2e69423-6988-4bd0-9a53-0d21008f3a14 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1298 microversion: 2.1 time: 0.086071 Jul 11 14:18:19.516426 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 239/464] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:19 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:20.472057 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f5067309-821d-414f-9b18-a185af55ef4c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:20.472739 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f5067309-821d-414f-9b18-a185af55ef4c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:20.479254 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f5067309-821d-414f-9b18-a185af55ef4c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:20.479703 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f5067309-821d-414f-9b18-a185af55ef4c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:20.480472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f5067309-821d-414f-9b18-a185af55ef4c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:20.480904 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f5067309-821d-414f-9b18-a185af55ef4c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:20.533233 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5f1440c4-2c6c-418e-9d5a-1a4e29da7cf0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:20.533845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5f1440c4-2c6c-418e-9d5a-1a4e29da7cf0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:20.540374 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f1440c4-2c6c-418e-9d5a-1a4e29da7cf0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:20.540826 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f1440c4-2c6c-418e-9d5a-1a4e29da7cf0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:20.541584 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f1440c4-2c6c-418e-9d5a-1a4e29da7cf0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:20.542012 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f1440c4-2c6c-418e-9d5a-1a4e29da7cf0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:20.607567 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5f1440c4-2c6c-418e-9d5a-1a4e29da7cf0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:20.615742 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5f1440c4-2c6c-418e-9d5a-1a4e29da7cf0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1298 microversion: 2.1 time: 0.086732 Jul 11 14:18:20.616334 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 240/465] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:20 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:20.621800 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f5067309-821d-414f-9b18-a185af55ef4c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:20.630724 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f5067309-821d-414f-9b18-a185af55ef4c tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1690 microversion: 2.1 time: 0.162541 Jul 11 14:18:20.631299 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 226/466] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:20 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:21.121693 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3d4a9e8d-b71f-40e6-aacd-dea164737340 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:21.122215 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3d4a9e8d-b71f-40e6-aacd-dea164737340 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:21.131224 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d4a9e8d-b71f-40e6-aacd-dea164737340 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:21.131690 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d4a9e8d-b71f-40e6-aacd-dea164737340 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:21.134389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d4a9e8d-b71f-40e6-aacd-dea164737340 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:21.134832 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d4a9e8d-b71f-40e6-aacd-dea164737340 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:21.219309 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-3d4a9e8d-b71f-40e6-aacd-dea164737340 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lazy-loading 'services' on Instance uuid 506dfd77-942c-437e-8f6f-fba1a71c48ae {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:18:21.290289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3d4a9e8d-b71f-40e6-aacd-dea164737340 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "DELETE /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae/os-volume_attachments/05b5c8e0-787b-43ea-a6ca-f6b8abf3fd22" status: 202 len: 0 microversion: 2.1 time: 0.172253 Jul 11 14:18:21.290893 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 241/467] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 11 14:18:21 2022] DELETE /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae/os-volume_attachments/05b5c8e0-787b-43ea-a6ca-f6b8abf3fd22 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:18:21.634051 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ed7b0d77-aaa5-471e-a219-be6c107214f7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:21.634692 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ed7b0d77-aaa5-471e-a219-be6c107214f7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:21.641799 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ed7b0d77-aaa5-471e-a219-be6c107214f7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:21.642279 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ed7b0d77-aaa5-471e-a219-be6c107214f7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:21.643132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ed7b0d77-aaa5-471e-a219-be6c107214f7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:21.643567 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ed7b0d77-aaa5-471e-a219-be6c107214f7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:21.649181 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-edcc38e9-b20b-4e61-9dd0-bc71c9b04295 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:21.649979 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-edcc38e9-b20b-4e61-9dd0-bc71c9b04295 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:21.656230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-edcc38e9-b20b-4e61-9dd0-bc71c9b04295 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:21.656671 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-edcc38e9-b20b-4e61-9dd0-bc71c9b04295 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:21.657500 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-edcc38e9-b20b-4e61-9dd0-bc71c9b04295 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:21.657861 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-edcc38e9-b20b-4e61-9dd0-bc71c9b04295 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:21.705575 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ed7b0d77-aaa5-471e-a219-be6c107214f7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:21.713136 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ed7b0d77-aaa5-471e-a219-be6c107214f7 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1298 microversion: 2.1 time: 0.082968 Jul 11 14:18:21.713704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 227/468] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:21 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:21.791767 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-edcc38e9-b20b-4e61-9dd0-bc71c9b04295 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:21.799868 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-edcc38e9-b20b-4e61-9dd0-bc71c9b04295 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1690 microversion: 2.1 time: 0.155316 Jul 11 14:18:21.800442 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 242/469] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:21 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:22.730004 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-306cd7dd-fa36-457a-a097-cfc00ecd014a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:22.730777 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-306cd7dd-fa36-457a-a097-cfc00ecd014a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:22.737232 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-306cd7dd-fa36-457a-a097-cfc00ecd014a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:22.737685 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-306cd7dd-fa36-457a-a097-cfc00ecd014a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:22.738492 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-306cd7dd-fa36-457a-a097-cfc00ecd014a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:22.738932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-306cd7dd-fa36-457a-a097-cfc00ecd014a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:22.810348 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-306cd7dd-fa36-457a-a097-cfc00ecd014a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:22.816075 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-19161b76-ecb4-4ca3-a9b2-19188381071e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:22.816747 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-19161b76-ecb4-4ca3-a9b2-19188381071e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:22.818379 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-306cd7dd-fa36-457a-a097-cfc00ecd014a tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1296 microversion: 2.1 time: 0.092166 Jul 11 14:18:22.818975 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 228/470] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:22 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:22.824030 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19161b76-ecb4-4ca3-a9b2-19188381071e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:22.824475 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19161b76-ecb4-4ca3-a9b2-19188381071e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:22.825255 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19161b76-ecb4-4ca3-a9b2-19188381071e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:22.825691 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19161b76-ecb4-4ca3-a9b2-19188381071e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:22.956869 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-19161b76-ecb4-4ca3-a9b2-19188381071e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:22.964434 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-19161b76-ecb4-4ca3-a9b2-19188381071e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1690 microversion: 2.1 time: 0.152188 Jul 11 14:18:22.965008 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 243/471] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:22 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:23.836598 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bb95ddb7-44e7-485e-9ccb-7c548c069ee4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:23.837210 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bb95ddb7-44e7-485e-9ccb-7c548c069ee4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:23.844621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb95ddb7-44e7-485e-9ccb-7c548c069ee4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:23.845062 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb95ddb7-44e7-485e-9ccb-7c548c069ee4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:23.845822 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb95ddb7-44e7-485e-9ccb-7c548c069ee4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:23.846283 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb95ddb7-44e7-485e-9ccb-7c548c069ee4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:23.912446 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bb95ddb7-44e7-485e-9ccb-7c548c069ee4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:23.924722 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bb95ddb7-44e7-485e-9ccb-7c548c069ee4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1296 microversion: 2.1 time: 0.091261 Jul 11 14:18:23.925730 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 229/472] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:23 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:23.981052 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-54504b75-b7e7-4c17-89f9-c092bd549d3d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:23.981586 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-54504b75-b7e7-4c17-89f9-c092bd549d3d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:23.988836 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54504b75-b7e7-4c17-89f9-c092bd549d3d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:23.989950 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54504b75-b7e7-4c17-89f9-c092bd549d3d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:23.991199 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54504b75-b7e7-4c17-89f9-c092bd549d3d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:23.991647 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54504b75-b7e7-4c17-89f9-c092bd549d3d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:24.355096 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-54504b75-b7e7-4c17-89f9-c092bd549d3d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:24.363433 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-54504b75-b7e7-4c17-89f9-c092bd549d3d tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1690 microversion: 2.1 time: 0.386387 Jul 11 14:18:24.364024 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 244/473] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:23 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1690 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:24.522807 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2e7787c7-fc1c-4568-9acc-02d92248c4ce tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:24.523321 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2e7787c7-fc1c-4568-9acc-02d92248c4ce tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:24.529864 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e7787c7-fc1c-4568-9acc-02d92248c4ce tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:24.530352 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e7787c7-fc1c-4568-9acc-02d92248c4ce tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:24.531336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e7787c7-fc1c-4568-9acc-02d92248c4ce tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:24.532036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e7787c7-fc1c-4568-9acc-02d92248c4ce tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:24.561307 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2e7787c7-fc1c-4568-9acc-02d92248c4ce tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:18:24.601025 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:24.657792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2e7787c7-fc1c-4568-9acc-02d92248c4ce tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "DELETE /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae" status: 204 len: 0 microversion: 2.1 time: 0.138510 Jul 11 14:18:24.658798 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 230/474] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:18:24 2022] DELETE /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:18:24.668762 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c0bd44e7-0b7a-4e44-a539-3347a7266b25 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:24.669496 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c0bd44e7-0b7a-4e44-a539-3347a7266b25 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:24.678483 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0bd44e7-0b7a-4e44-a539-3347a7266b25 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:24.680718 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0bd44e7-0b7a-4e44-a539-3347a7266b25 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:24.681509 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0bd44e7-0b7a-4e44-a539-3347a7266b25 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:24.681927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0bd44e7-0b7a-4e44-a539-3347a7266b25 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:24.943730 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5412cfa7-bf17-4f5f-990a-159065282a00 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:24.944463 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5412cfa7-bf17-4f5f-990a-159065282a00 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:24.951905 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5412cfa7-bf17-4f5f-990a-159065282a00 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:24.952571 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5412cfa7-bf17-4f5f-990a-159065282a00 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:24.953788 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5412cfa7-bf17-4f5f-990a-159065282a00 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:24.953788 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5412cfa7-bf17-4f5f-990a-159065282a00 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:25.005954 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c0bd44e7-0b7a-4e44-a539-3347a7266b25 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:25.015191 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c0bd44e7-0b7a-4e44-a539-3347a7266b25 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae" status: 200 len: 1513 microversion: 2.1 time: 0.351348 Jul 11 14:18:25.016467 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 245/475] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:24 2022] GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae => generated 1513 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:25.047285 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-6688f6c7-38d5-4aa7-8fdd-821414f5ead8 req-79548dca-4075-43bb-9503-77409ac14c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413449f2-c97f-4bb8-a3c8-e8447fe3d1a8", "name": "network-vif-deleted", "tag": "8bfd8a36-2339-4c5c-9836-b9d0b3694f20"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:25.056929 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-6688f6c7-38d5-4aa7-8fdd-821414f5ead8 req-79548dca-4075-43bb-9503-77409ac14c15 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:25.057567 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-6688f6c7-38d5-4aa7-8fdd-821414f5ead8 req-79548dca-4075-43bb-9503-77409ac14c15 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:25.069647 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-6688f6c7-38d5-4aa7-8fdd-821414f5ead8 req-79548dca-4075-43bb-9503-77409ac14c15 service nova] Creating event network-vif-deleted:8bfd8a36-2339-4c5c-9836-b9d0b3694f20 for instance 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 on hv-cinder-81914 Jul 11 14:18:25.077133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-6688f6c7-38d5-4aa7-8fdd-821414f5ead8 req-79548dca-4075-43bb-9503-77409ac14c15 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032139 Jul 11 14:18:25.078255 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 246/476] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:18:25.106728 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5412cfa7-bf17-4f5f-990a-159065282a00 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:25.115397 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5412cfa7-bf17-4f5f-990a-159065282a00 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1362 microversion: 2.1 time: 0.175965 Jul 11 14:18:25.116060 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 231/477] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:24 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:25.381762 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7468fd2b-3603-4b0e-bef4-a4dd98f88b62 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:25.382516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7468fd2b-3603-4b0e-bef4-a4dd98f88b62 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:25.389211 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7468fd2b-3603-4b0e-bef4-a4dd98f88b62 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:25.389670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7468fd2b-3603-4b0e-bef4-a4dd98f88b62 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:25.390541 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7468fd2b-3603-4b0e-bef4-a4dd98f88b62 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:25.390979 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7468fd2b-3603-4b0e-bef4-a4dd98f88b62 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:25.478541 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7468fd2b-3603-4b0e-bef4-a4dd98f88b62 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:25.487939 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7468fd2b-3603-4b0e-bef4-a4dd98f88b62 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1622 microversion: 2.1 time: 0.110467 Jul 11 14:18:25.488538 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 247/478] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:25 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1622 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:26.032095 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5f13ce75-dc8a-45c3-ba2c-88547ce6a69d tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:26.032697 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5f13ce75-dc8a-45c3-ba2c-88547ce6a69d tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:26.039761 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f13ce75-dc8a-45c3-ba2c-88547ce6a69d tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:26.040103 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f13ce75-dc8a-45c3-ba2c-88547ce6a69d tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:26.040885 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f13ce75-dc8a-45c3-ba2c-88547ce6a69d tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:26.041319 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f13ce75-dc8a-45c3-ba2c-88547ce6a69d tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:26.132816 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9cba8644-6158-4e03-87f3-432eb04b8cdd tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:26.133431 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9cba8644-6158-4e03-87f3-432eb04b8cdd tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:26.141092 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9cba8644-6158-4e03-87f3-432eb04b8cdd tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:26.141545 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9cba8644-6158-4e03-87f3-432eb04b8cdd tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:26.142360 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9cba8644-6158-4e03-87f3-432eb04b8cdd tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:26.142799 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9cba8644-6158-4e03-87f3-432eb04b8cdd tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:26.179477 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5f13ce75-dc8a-45c3-ba2c-88547ce6a69d tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:26.187644 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5f13ce75-dc8a-45c3-ba2c-88547ce6a69d tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae" status: 200 len: 1513 microversion: 2.1 time: 0.159475 Jul 11 14:18:26.188228 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 232/479] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:26 2022] GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:26.291726 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9cba8644-6158-4e03-87f3-432eb04b8cdd tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:26.302071 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9cba8644-6158-4e03-87f3-432eb04b8cdd tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1362 microversion: 2.1 time: 0.172962 Jul 11 14:18:26.312468 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 248/480] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:26 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:26.505851 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ae4a6251-7426-4c48-a536-c037e6bf90e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:26.506465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ae4a6251-7426-4c48-a536-c037e6bf90e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:26.513293 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae4a6251-7426-4c48-a536-c037e6bf90e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:26.513739 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae4a6251-7426-4c48-a536-c037e6bf90e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:26.514583 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae4a6251-7426-4c48-a536-c037e6bf90e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:26.515010 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae4a6251-7426-4c48-a536-c037e6bf90e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:26.546512 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae4a6251-7426-4c48-a536-c037e6bf90e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:26.546923 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae4a6251-7426-4c48-a536-c037e6bf90e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:26.547397 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-ae4a6251-7426-4c48-a536-c037e6bf90e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lazy-loading 'fault' on Instance uuid 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:18:26.593278 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ae4a6251-7426-4c48-a536-c037e6bf90e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:26.600841 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ae4a6251-7426-4c48-a536-c037e6bf90e8 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 200 len: 1336 microversion: 2.1 time: 0.098788 Jul 11 14:18:26.601407 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 233/481] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:26 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 1336 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:27.118406 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-63ca216d-466e-4055-b997-142103d4604e req-3a5ebb4f-6f73-460f-b795-014a933c581d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c2d5cb-d011-4621-90f0-2fac11059be2", "tag": "1eaca124-07e0-4a06-9731-c5df81cfe7c9"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:27.125370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:27.137452 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-63ca216d-466e-4055-b997-142103d4604e req-3a5ebb4f-6f73-460f-b795-014a933c581d service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:27.138253 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-63ca216d-466e-4055-b997-142103d4604e req-3a5ebb4f-6f73-460f-b795-014a933c581d service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:27.159818 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-63ca216d-466e-4055-b997-142103d4604e req-3a5ebb4f-6f73-460f-b795-014a933c581d service nova] Creating event network-changed:1eaca124-07e0-4a06-9731-c5df81cfe7c9 for instance f2c2d5cb-d011-4621-90f0-2fac11059be2 on hv-cinder-81914 Jul 11 14:18:27.168348 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-63ca216d-466e-4055-b997-142103d4604e req-3a5ebb4f-6f73-460f-b795-014a933c581d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055234 Jul 11 14:18:27.169430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 249/482] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:18:27.206364 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6061cb12-d0de-4db7-9668-9f73f291a108 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:27.206909 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6061cb12-d0de-4db7-9668-9f73f291a108 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:27.209400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:27.210190 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=10 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:27.218731 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6061cb12-d0de-4db7-9668-9f73f291a108 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:27.219186 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6061cb12-d0de-4db7-9668-9f73f291a108 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:27.220005 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6061cb12-d0de-4db7-9668-9f73f291a108 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:27.220473 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6061cb12-d0de-4db7-9668-9f73f291a108 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:27.317141 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:27.321822 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3a76023b-ec5f-4873-95e6-537dccbe3474 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:27.322694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3a76023b-ec5f-4873-95e6-537dccbe3474 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:27.329722 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a76023b-ec5f-4873-95e6-537dccbe3474 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:27.330495 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a76023b-ec5f-4873-95e6-537dccbe3474 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:27.331424 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a76023b-ec5f-4873-95e6-537dccbe3474 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:27.331969 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a76023b-ec5f-4873-95e6-537dccbe3474 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:27.358605 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6061cb12-d0de-4db7-9668-9f73f291a108 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:27.367718 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6061cb12-d0de-4db7-9668-9f73f291a108 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae" status: 200 len: 1513 microversion: 2.1 time: 0.165351 Jul 11 14:18:27.368619 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 234/483] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:27 2022] GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:27.587309 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3a76023b-ec5f-4873-95e6-537dccbe3474 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:27.597500 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3a76023b-ec5f-4873-95e6-537dccbe3474 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1362 microversion: 2.1 time: 0.281188 Jul 11 14:18:27.607312 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 250/484] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:27 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:27.618447 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e4c718ef-906e-4bc9-8d93-ad38c1a9c3f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:27.619064 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e4c718ef-906e-4bc9-8d93-ad38c1a9c3f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:27.627936 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e4c718ef-906e-4bc9-8d93-ad38c1a9c3f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:27.628393 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e4c718ef-906e-4bc9-8d93-ad38c1a9c3f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:27.629786 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e4c718ef-906e-4bc9-8d93-ad38c1a9c3f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:27.630392 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e4c718ef-906e-4bc9-8d93-ad38c1a9c3f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:27.648624 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-e4c718ef-906e-4bc9-8d93-ad38c1a9c3f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] HTTP exception thrown: Instance 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 could not be found. Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e4c718ef-906e-4bc9-8d93-ad38c1a9c3f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Request method failure captured: Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 HTTP/1.1 Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDACP6mdhrBbHb9S3XX22Eb0vYXjhp1e_LptzxBkzLwvBvJ1-7gB1TqSdpdJ5YeHgf2tmnMDlqCnoElwnEKtizDSMd2V06J3G6UnMcuGg7PNEVrEt6Rrsspv6l6ei_5BXqbOVaeGYCCinqLdi82bSV7C8J2_OU2nV_ohEovCqh80m6I Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 15d95b0cae244d99885be229335ea541 Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1246670355 Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:18:27.650318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:18:27.651679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15d95b0cae244d99885be229335ea541"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15d95b0cae244d99885be229335ea541"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15d95b0cae244d99885be229335ea541"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15d95b0cae244d99885be229335ea541"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:18:27.651679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1246670355 Jul 11 14:18:27.651679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 15d95b0cae244d99885be229335ea541 Jul 11 14:18:27.651679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1246670355 Jul 11 14:18:27.651679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-ServerRescueNegativeTestJSON-1246670355-project Jul 11 14:18:27.651679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:18:27.651679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:18:27.651679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 39a5cea0a591453581a9d98ff796d973 Jul 11 14:18:27.651679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1246670355-project Jul 11 14:18:27.651679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:18:27.651679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 could not be found. Jul 11 14:18:27.651679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': '413449f2-c97f-4bb8-a3c8-e8447fe3d1a8'} Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 could not be found. Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:18:27.652523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:18:27.653948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:18:27.653948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:18:27.653948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:18:27.653948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:18:27.653948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:18:27.653948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:18:27.653948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:18:27.653948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 could not be found. Jul 11 14:18:27.653948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:18:27.653948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:18:27.653948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:18:27.653948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:18:27.653948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:18:27.653948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:18:27.653948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:18:27.653948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:18:27.653948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 could not be found. Jul 11 14:18:27.653948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:18:27.656778 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e4c718ef-906e-4bc9-8d93-ad38c1a9c3f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Returning 404 to user: Instance 413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:18:27.656778 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e4c718ef-906e-4bc9-8d93-ad38c1a9c3f1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8" status: 404 len: 111 microversion: 2.1 time: 0.037411 Jul 11 14:18:27.656778 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 235/485] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:27 2022] GET /compute/v2.1/servers/413449f2-c97f-4bb8-a3c8-e8447fe3d1a8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 14:18:27.661474 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-09c580f4-4ed8-45d3-8deb-1d4f7cbd15d2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '.version_select at 0x7fc976cc7c10>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:27.681742 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-09c580f4-4ed8-45d3-8deb-1d4f7cbd15d2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1090503969" status: 202 len: 0 microversion: 2.1 time: 0.023940 Jul 11 14:18:27.682355 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 251/486] 10.222.0.66 () {58 vars in 1220 bytes} [Mon Jul 11 14:18:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1090503969 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:18:28.385625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5b30b246-4862-4d3e-b0f0-cfe76333727b tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:28.386416 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5b30b246-4862-4d3e-b0f0-cfe76333727b tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:28.394742 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b30b246-4862-4d3e-b0f0-cfe76333727b tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:28.395185 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b30b246-4862-4d3e-b0f0-cfe76333727b tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:28.395945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b30b246-4862-4d3e-b0f0-cfe76333727b tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:28.396406 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b30b246-4862-4d3e-b0f0-cfe76333727b tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:28.463792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5b30b246-4862-4d3e-b0f0-cfe76333727b tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:28.471408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5b30b246-4862-4d3e-b0f0-cfe76333727b tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae" status: 200 len: 1471 microversion: 2.1 time: 0.089779 Jul 11 14:18:28.471972 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 236/487] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:28 2022] GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae => generated 1471 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:28.615945 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b6f26e9e-fb21-45ee-9297-c33a93ced790 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:28.617470 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b6f26e9e-fb21-45ee-9297-c33a93ced790 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:28.625134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6f26e9e-fb21-45ee-9297-c33a93ced790 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:28.625908 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6f26e9e-fb21-45ee-9297-c33a93ced790 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:28.626914 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6f26e9e-fb21-45ee-9297-c33a93ced790 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:28.627549 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6f26e9e-fb21-45ee-9297-c33a93ced790 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:28.787619 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b6f26e9e-fb21-45ee-9297-c33a93ced790 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:28.795161 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b6f26e9e-fb21-45ee-9297-c33a93ced790 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1362 microversion: 2.1 time: 0.184249 Jul 11 14:18:28.795732 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 252/488] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:28 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:29.207895 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-7788b959-de2f-4172-b6cb-708bf956f3a7 req-53ea6698-6a85-4bb5-9383-c53bba1c9bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "506dfd77-942c-437e-8f6f-fba1a71c48ae", "name": "network-vif-deleted", "tag": "f73a5b2f-9545-4615-8beb-4e5b67809168"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:29.217191 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-7788b959-de2f-4172-b6cb-708bf956f3a7 req-53ea6698-6a85-4bb5-9383-c53bba1c9bec service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:29.217638 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-7788b959-de2f-4172-b6cb-708bf956f3a7 req-53ea6698-6a85-4bb5-9383-c53bba1c9bec service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:29.229057 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-7788b959-de2f-4172-b6cb-708bf956f3a7 req-53ea6698-6a85-4bb5-9383-c53bba1c9bec service nova] Creating event network-vif-deleted:f73a5b2f-9545-4615-8beb-4e5b67809168 for instance 506dfd77-942c-437e-8f6f-fba1a71c48ae on hv-cinder-81914 Jul 11 14:18:29.235063 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-7788b959-de2f-4172-b6cb-708bf956f3a7 req-53ea6698-6a85-4bb5-9383-c53bba1c9bec service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032148 Jul 11 14:18:29.235676 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 237/489] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:18:29.488193 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-65732a43-c7b4-429f-b9cd-ed37698df753 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:29.488997 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-65732a43-c7b4-429f-b9cd-ed37698df753 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 506dfd77-942c-437e-8f6f-fba1a71c48ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:29.495462 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65732a43-c7b4-429f-b9cd-ed37698df753 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:29.496354 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65732a43-c7b4-429f-b9cd-ed37698df753 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:29.496695 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65732a43-c7b4-429f-b9cd-ed37698df753 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:29.497126 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65732a43-c7b4-429f-b9cd-ed37698df753 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:29.512140 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-65732a43-c7b4-429f-b9cd-ed37698df753 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] HTTP exception thrown: Instance 506dfd77-942c-437e-8f6f-fba1a71c48ae could not be found. Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-65732a43-c7b4-429f-b9cd-ed37698df753 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Request method failure captured: Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae HTTP/1.1 Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDD0fNJS0sr0qVqhq5ktbXDYA6SEfqZSpjRbXCxnjZ030fiszN_3UtHxe5LjDufraxk0JwzrhYoHinF-j4pAYOTpkMWJ7a7Apf2m65fUNtfb9ad9w8eZjnjYW16krE7dXiGyEw-k1zDlUfukkFqKzAHiG8MGKXgpjYNQHEsvpOSbk6Q Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 85f9647b786a44948b284da50555b62f Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1658299685 Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:18:29.513821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:18:29.515629 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_85f9647b786a44948b284da50555b62f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/85f9647b786a44948b284da50555b62f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/85f9647b786a44948b284da50555b62f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/85f9647b786a44948b284da50555b62f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:18:29.515629 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesSnapshotTestJSON-1658299685 Jul 11 14:18:29.515629 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 85f9647b786a44948b284da50555b62f Jul 11 14:18:29.515629 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1658299685 Jul 11 14:18:29.515629 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesSnapshotTestJSON-1658299685-project Jul 11 14:18:29.515629 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:18:29.515629 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:18:29.515629 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: ade7dda2cc0a49beb162804d36977079 Jul 11 14:18:29.515629 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesSnapshotTestJSON-1658299685-project Jul 11 14:18:29.515629 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:18:29.515629 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance 506dfd77-942c-437e-8f6f-fba1a71c48ae could not be found. Jul 11 14:18:29.515629 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': '506dfd77-942c-437e-8f6f-fba1a71c48ae'} Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 506dfd77-942c-437e-8f6f-fba1a71c48ae could not be found. Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:18:29.516476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:18:29.517828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:18:29.517828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:18:29.517828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:18:29.517828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:18:29.517828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:18:29.517828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:18:29.517828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:18:29.517828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 506dfd77-942c-437e-8f6f-fba1a71c48ae could not be found. Jul 11 14:18:29.517828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:18:29.517828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:18:29.517828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:18:29.517828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:18:29.517828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:18:29.517828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:18:29.517828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:18:29.517828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:18:29.517828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 506dfd77-942c-437e-8f6f-fba1a71c48ae could not be found. Jul 11 14:18:29.517828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:18:29.530316 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-65732a43-c7b4-429f-b9cd-ed37698df753 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Returning 404 to user: Instance 506dfd77-942c-437e-8f6f-fba1a71c48ae could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:18:29.530316 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-65732a43-c7b4-429f-b9cd-ed37698df753 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae" status: 404 len: 111 microversion: 2.1 time: 0.031912 Jul 11 14:18:29.530316 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 253/490] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:29 2022] GET /compute/v2.1/servers/506dfd77-942c-437e-8f6f-fba1a71c48ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:18:29.816236 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7e49a601-9779-4eef-bbd6-8868047699a0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:29.816958 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7e49a601-9779-4eef-bbd6-8868047699a0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:29.824895 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e49a601-9779-4eef-bbd6-8868047699a0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:29.825557 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e49a601-9779-4eef-bbd6-8868047699a0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:29.826633 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e49a601-9779-4eef-bbd6-8868047699a0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:29.827193 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e49a601-9779-4eef-bbd6-8868047699a0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:29.968554 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7e49a601-9779-4eef-bbd6-8868047699a0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:29.976170 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7e49a601-9779-4eef-bbd6-8868047699a0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1362 microversion: 2.1 time: 0.166273 Jul 11 14:18:29.976799 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 238/491] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:29 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:30.571697 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-611c00f7-54f4-48c6-b8c2-943b897b811e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:30.572223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-611c00f7-54f4-48c6-b8c2-943b897b811e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:30.578992 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-611c00f7-54f4-48c6-b8c2-943b897b811e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:30.579439 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-611c00f7-54f4-48c6-b8c2-943b897b811e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:30.580202 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-611c00f7-54f4-48c6-b8c2-943b897b811e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:30.580639 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-611c00f7-54f4-48c6-b8c2-943b897b811e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:30.608065 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-611c00f7-54f4-48c6-b8c2-943b897b811e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:18:30.684494 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-611c00f7-54f4-48c6-b8c2-943b897b811e tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "DELETE /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 204 len: 0 microversion: 2.1 time: 0.116297 Jul 11 14:18:30.685169 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 254/492] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:18:30 2022] DELETE /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:18:30.693891 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-99317670-bba7-4b77-a4e9-1196f990d195 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:30.694545 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-99317670-bba7-4b77-a4e9-1196f990d195 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:30.700692 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99317670-bba7-4b77-a4e9-1196f990d195 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:30.701149 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99317670-bba7-4b77-a4e9-1196f990d195 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:30.701922 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99317670-bba7-4b77-a4e9-1196f990d195 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:30.702601 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99317670-bba7-4b77-a4e9-1196f990d195 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:30.834473 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-99317670-bba7-4b77-a4e9-1196f990d195 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:30.841924 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-99317670-bba7-4b77-a4e9-1196f990d195 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1507 microversion: 2.1 time: 0.152341 Jul 11 14:18:30.842515 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 239/493] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:30 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:31.050116 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a04bce9a-45f1-48c8-837d-e571695a75d4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:31.050861 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a04bce9a-45f1-48c8-837d-e571695a75d4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:31.057056 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a04bce9a-45f1-48c8-837d-e571695a75d4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:31.057501 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a04bce9a-45f1-48c8-837d-e571695a75d4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:31.058298 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a04bce9a-45f1-48c8-837d-e571695a75d4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:31.058731 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a04bce9a-45f1-48c8-837d-e571695a75d4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:31.192664 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a04bce9a-45f1-48c8-837d-e571695a75d4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:31.196227 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:31.200727 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a04bce9a-45f1-48c8-837d-e571695a75d4 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1362 microversion: 2.1 time: 0.210408 Jul 11 14:18:31.201524 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 255/494] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:30 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:31.860272 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4f9e0451-9ffa-464b-ba02-7f43f7357719 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:31.860805 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4f9e0451-9ffa-464b-ba02-7f43f7357719 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:31.867347 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f9e0451-9ffa-464b-ba02-7f43f7357719 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:31.867788 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f9e0451-9ffa-464b-ba02-7f43f7357719 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:31.868545 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f9e0451-9ffa-464b-ba02-7f43f7357719 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:31.868974 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f9e0451-9ffa-464b-ba02-7f43f7357719 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:32.003120 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4f9e0451-9ffa-464b-ba02-7f43f7357719 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:32.010526 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4f9e0451-9ffa-464b-ba02-7f43f7357719 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1507 microversion: 2.1 time: 0.155077 Jul 11 14:18:32.011093 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 240/495] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:31 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:32.219118 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-14b805be-fceb-4d95-b10e-bace03cd2b57 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:32.219766 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-14b805be-fceb-4d95-b10e-bace03cd2b57 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:32.228114 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14b805be-fceb-4d95-b10e-bace03cd2b57 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:32.228561 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14b805be-fceb-4d95-b10e-bace03cd2b57 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:32.229335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14b805be-fceb-4d95-b10e-bace03cd2b57 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:32.229769 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14b805be-fceb-4d95-b10e-bace03cd2b57 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:32.359487 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-14b805be-fceb-4d95-b10e-bace03cd2b57 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:32.367041 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-14b805be-fceb-4d95-b10e-bace03cd2b57 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1362 microversion: 2.1 time: 0.152668 Jul 11 14:18:32.367613 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 256/496] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:32 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:32.918764 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-011e0580-6128-4491-9ac2-255904940fdc req-c1193210-7697-46c9-8802-2ff1940ab0bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c2d5cb-d011-4621-90f0-2fac11059be2", "name": "network-vif-plugged", "status": "completed", "tag": "1eaca124-07e0-4a06-9731-c5df81cfe7c9"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:32.928713 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-011e0580-6128-4491-9ac2-255904940fdc req-c1193210-7697-46c9-8802-2ff1940ab0bf service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:32.929218 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-011e0580-6128-4491-9ac2-255904940fdc req-c1193210-7697-46c9-8802-2ff1940ab0bf service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:32.941360 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-011e0580-6128-4491-9ac2-255904940fdc req-c1193210-7697-46c9-8802-2ff1940ab0bf service nova] Creating event network-vif-plugged:1eaca124-07e0-4a06-9731-c5df81cfe7c9 for instance f2c2d5cb-d011-4621-90f0-2fac11059be2 on hv-cinder-81914 Jul 11 14:18:32.946291 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-011e0580-6128-4491-9ac2-255904940fdc req-c1193210-7697-46c9-8802-2ff1940ab0bf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031805 Jul 11 14:18:32.946892 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 241/497] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:18:33.027578 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e60a5356-512b-497c-b64b-abcf136c1708 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:33.028187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e60a5356-512b-497c-b64b-abcf136c1708 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:33.035230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e60a5356-512b-497c-b64b-abcf136c1708 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:33.035772 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e60a5356-512b-497c-b64b-abcf136c1708 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:33.036589 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e60a5356-512b-497c-b64b-abcf136c1708 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:33.037080 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e60a5356-512b-497c-b64b-abcf136c1708 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:33.173896 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e60a5356-512b-497c-b64b-abcf136c1708 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:33.181457 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e60a5356-512b-497c-b64b-abcf136c1708 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1507 microversion: 2.1 time: 0.157809 Jul 11 14:18:33.182030 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 257/498] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:33 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:33.283404 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:18:33.284061 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Mon Jul 11 14:18:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:18:33.384671 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8ce75c21-acec-4c77-9ef1-609a159732f2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:33.385287 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8ce75c21-acec-4c77-9ef1-609a159732f2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:33.392271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ce75c21-acec-4c77-9ef1-609a159732f2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:33.392716 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ce75c21-acec-4c77-9ef1-609a159732f2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:33.393486 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ce75c21-acec-4c77-9ef1-609a159732f2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:33.393921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ce75c21-acec-4c77-9ef1-609a159732f2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:33.523816 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8ce75c21-acec-4c77-9ef1-609a159732f2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:33.531287 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8ce75c21-acec-4c77-9ef1-609a159732f2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1362 microversion: 2.1 time: 0.150958 Jul 11 14:18:33.531862 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 242/499] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:33 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:34.211455 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-00dedb81-5e35-45a5-9f6d-37c8dbff7050 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:34.213300 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-00dedb81-5e35-45a5-9f6d-37c8dbff7050 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:34.220497 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00dedb81-5e35-45a5-9f6d-37c8dbff7050 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:34.220957 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00dedb81-5e35-45a5-9f6d-37c8dbff7050 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:34.221743 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00dedb81-5e35-45a5-9f6d-37c8dbff7050 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:34.222206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00dedb81-5e35-45a5-9f6d-37c8dbff7050 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:34.357846 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-00dedb81-5e35-45a5-9f6d-37c8dbff7050 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:34.365436 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-00dedb81-5e35-45a5-9f6d-37c8dbff7050 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1507 microversion: 2.1 time: 0.161401 Jul 11 14:18:34.366003 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 258/500] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:34 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:34.549006 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-93391f5b-9baa-48a3-986d-49e5ba09ce71 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:34.549635 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-93391f5b-9baa-48a3-986d-49e5ba09ce71 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:34.552185 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:34.558005 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-93391f5b-9baa-48a3-986d-49e5ba09ce71 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:34.558410 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-93391f5b-9baa-48a3-986d-49e5ba09ce71 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:34.559273 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-93391f5b-9baa-48a3-986d-49e5ba09ce71 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:34.559712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-93391f5b-9baa-48a3-986d-49e5ba09ce71 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:34.707582 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-93391f5b-9baa-48a3-986d-49e5ba09ce71 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:34.715039 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-93391f5b-9baa-48a3-986d-49e5ba09ce71 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1362 microversion: 2.1 time: 0.170529 Jul 11 14:18:34.715611 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 243/501] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:34 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:35.383345 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1efe82a8-7bcc-45a6-a76a-dbbcdcf65930 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:35.383990 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1efe82a8-7bcc-45a6-a76a-dbbcdcf65930 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:35.391042 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1efe82a8-7bcc-45a6-a76a-dbbcdcf65930 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:35.391490 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1efe82a8-7bcc-45a6-a76a-dbbcdcf65930 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:35.392255 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1efe82a8-7bcc-45a6-a76a-dbbcdcf65930 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:35.392687 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1efe82a8-7bcc-45a6-a76a-dbbcdcf65930 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:35.522631 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1efe82a8-7bcc-45a6-a76a-dbbcdcf65930 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:35.530752 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1efe82a8-7bcc-45a6-a76a-dbbcdcf65930 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1507 microversion: 2.1 time: 0.150678 Jul 11 14:18:35.531322 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 259/502] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:35 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:35.731761 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3ade7383-67bc-47f1-adbf-e138b5e82716 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:35.732298 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3ade7383-67bc-47f1-adbf-e138b5e82716 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:35.739084 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ade7383-67bc-47f1-adbf-e138b5e82716 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:35.739536 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ade7383-67bc-47f1-adbf-e138b5e82716 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:35.740307 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ade7383-67bc-47f1-adbf-e138b5e82716 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:35.740744 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ade7383-67bc-47f1-adbf-e138b5e82716 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:35.884143 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3ade7383-67bc-47f1-adbf-e138b5e82716 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:35.892404 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3ade7383-67bc-47f1-adbf-e138b5e82716 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1362 microversion: 2.1 time: 0.164591 Jul 11 14:18:35.892968 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 244/503] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:35 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:36.548254 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3106d8ed-535f-46ac-a3c8-4c4cfbedf68a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:36.548813 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3106d8ed-535f-46ac-a3c8-4c4cfbedf68a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:36.555266 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3106d8ed-535f-46ac-a3c8-4c4cfbedf68a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:36.555708 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3106d8ed-535f-46ac-a3c8-4c4cfbedf68a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:36.556457 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3106d8ed-535f-46ac-a3c8-4c4cfbedf68a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:36.556883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3106d8ed-535f-46ac-a3c8-4c4cfbedf68a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:36.705245 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3106d8ed-535f-46ac-a3c8-4c4cfbedf68a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:36.712819 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3106d8ed-535f-46ac-a3c8-4c4cfbedf68a tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1507 microversion: 2.1 time: 0.169111 Jul 11 14:18:36.713389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 260/504] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:36 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:36.782583 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4bd80b9a-b287-41e4-98e1-6803252faf37 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:36.783173 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4bd80b9a-b287-41e4-98e1-6803252faf37 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:36.789760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4bd80b9a-b287-41e4-98e1-6803252faf37 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:36.790261 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4bd80b9a-b287-41e4-98e1-6803252faf37 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:36.791031 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4bd80b9a-b287-41e4-98e1-6803252faf37 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:36.791471 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4bd80b9a-b287-41e4-98e1-6803252faf37 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:36.814041 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-4bd80b9a-b287-41e4-98e1-6803252faf37 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lazy-loading 'flavor' on Instance uuid 374e3321-9408-4c7b-b2c3-8be5d7ed6561 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:18:36.888148 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4bd80b9a-b287-41e4-98e1-6803252faf37 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "POST /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561/action" status: 202 len: 0 microversion: 2.1 time: 0.110031 Jul 11 14:18:36.888758 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 245/505] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 11 14:18:36 2022] POST /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:18:36.897747 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ee6f3c8b-7422-472d-a47d-cf6907c139f4 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:36.898386 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ee6f3c8b-7422-472d-a47d-cf6907c139f4 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:36.904456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee6f3c8b-7422-472d-a47d-cf6907c139f4 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:36.905597 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee6f3c8b-7422-472d-a47d-cf6907c139f4 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:36.906394 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee6f3c8b-7422-472d-a47d-cf6907c139f4 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:36.906822 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee6f3c8b-7422-472d-a47d-cf6907c139f4 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:36.909899 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-188459fe-ecd6-463c-adff-bd73590cb2ff tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:36.910653 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-188459fe-ecd6-463c-adff-bd73590cb2ff tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:36.916895 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-188459fe-ecd6-463c-adff-bd73590cb2ff tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:36.917449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-188459fe-ecd6-463c-adff-bd73590cb2ff tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:36.918371 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-188459fe-ecd6-463c-adff-bd73590cb2ff tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:36.918713 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-188459fe-ecd6-463c-adff-bd73590cb2ff tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:36.939140 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:37.043789 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ee6f3c8b-7422-472d-a47d-cf6907c139f4 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:37.052815 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ee6f3c8b-7422-472d-a47d-cf6907c139f4 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1567 microversion: 2.1 time: 0.158779 Jul 11 14:18:37.053830 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 261/506] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:36 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:37.067849 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-188459fe-ecd6-463c-adff-bd73590cb2ff tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:37.075447 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-188459fe-ecd6-463c-adff-bd73590cb2ff tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1362 microversion: 2.1 time: 0.170416 Jul 11 14:18:37.076026 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 246/507] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:36 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:37.302813 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0df3b19e-27b8-42c1-8d28-acd80ba17b08 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-130823228", "imageRef": "67874ac7-fac8-4d6d-9cd1-9091ecb957b6", "flavorRef": "452", "networks": [{"uuid": "63ab0621-ba7a-4083-966a-ad0e83277490"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:37.353890 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-0df3b19e-27b8-42c1-8d28-acd80ba17b08 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] validate_networks() for [('63ab0621-ba7a-4083-966a-ad0e83277490', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:18:37.730439 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4cfe131c-91aa-4b90-94e6-63e80a1a8c65 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:37.731055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4cfe131c-91aa-4b90-94e6-63e80a1a8c65 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:37.737717 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4cfe131c-91aa-4b90-94e6-63e80a1a8c65 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:37.738178 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4cfe131c-91aa-4b90-94e6-63e80a1a8c65 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:37.738961 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4cfe131c-91aa-4b90-94e6-63e80a1a8c65 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:37.739393 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4cfe131c-91aa-4b90-94e6-63e80a1a8c65 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:37.877530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4cfe131c-91aa-4b90-94e6-63e80a1a8c65 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:37.885138 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4cfe131c-91aa-4b90-94e6-63e80a1a8c65 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1507 microversion: 2.1 time: 0.158609 Jul 11 14:18:37.885722 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 247/508] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:37 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:38.071831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-971f7ca1-784b-4fcf-8f9d-b853d0283609 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:38.072468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-971f7ca1-784b-4fcf-8f9d-b853d0283609 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:38.082430 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-971f7ca1-784b-4fcf-8f9d-b853d0283609 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:38.083585 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-971f7ca1-784b-4fcf-8f9d-b853d0283609 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:38.085605 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-971f7ca1-784b-4fcf-8f9d-b853d0283609 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:38.086042 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-971f7ca1-784b-4fcf-8f9d-b853d0283609 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:38.231444 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-971f7ca1-784b-4fcf-8f9d-b853d0283609 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:38.239802 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-0df3b19e-27b8-42c1-8d28-acd80ba17b08 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:18:38.240293 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-971f7ca1-784b-4fcf-8f9d-b853d0283609 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1567 microversion: 2.1 time: 0.172237 Jul 11 14:18:38.240393 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-0df3b19e-27b8-42c1-8d28-acd80ba17b08 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:18:38.240687 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-0df3b19e-27b8-42c1-8d28-acd80ba17b08 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:18:38.241515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-0df3b19e-27b8-42c1-8d28-acd80ba17b08 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:18:38.242254 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-0df3b19e-27b8-42c1-8d28-acd80ba17b08 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:18:38.252473 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 248/509] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:38 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:38.256145 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0df3b19e-27b8-42c1-8d28-acd80ba17b08 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:38.257088 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0df3b19e-27b8-42c1-8d28-acd80ba17b08 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:38.257927 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-57c80941-9cb2-49ec-9632-e5f9b9723cb3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:38.257927 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-57c80941-9cb2-49ec-9632-e5f9b9723cb3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:38.259891 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0df3b19e-27b8-42c1-8d28-acd80ba17b08 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:38.260438 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0df3b19e-27b8-42c1-8d28-acd80ba17b08 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:38.266433 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57c80941-9cb2-49ec-9632-e5f9b9723cb3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:38.266994 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57c80941-9cb2-49ec-9632-e5f9b9723cb3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:38.267794 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57c80941-9cb2-49ec-9632-e5f9b9723cb3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:38.268232 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57c80941-9cb2-49ec-9632-e5f9b9723cb3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:38.286369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-0df3b19e-27b8-42c1-8d28-acd80ba17b08 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Getting quotas for project 85f9647b786a44948b284da50555b62f. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:18:38.290724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-0df3b19e-27b8-42c1-8d28-acd80ba17b08 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Getting quotas for user ade7dda2cc0a49beb162804d36977079 and project 85f9647b786a44948b284da50555b62f. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:18:38.303390 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0df3b19e-27b8-42c1-8d28-acd80ba17b08 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:18:38.306383 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0df3b19e-27b8-42c1-8d28-acd80ba17b08 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67874ac7-fac8-4d6d-9cd1-9091ecb957b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:18:38.361169 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0df3b19e-27b8-42c1-8d28-acd80ba17b08 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.062115 Jul 11 14:18:38.362026 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 262/510] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:18:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:18:38.372856 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6426e4ce-064a-4fb8-b8b5-8fdee464f09e tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:38.373608 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6426e4ce-064a-4fb8-b8b5-8fdee464f09e tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:38.429696 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-57c80941-9cb2-49ec-9632-e5f9b9723cb3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:38.442256 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-57c80941-9cb2-49ec-9632-e5f9b9723cb3 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1362 microversion: 2.1 time: 0.188731 Jul 11 14:18:38.443434 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 249/511] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:38 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:38.478105 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6426e4ce-064a-4fb8-b8b5-8fdee464f09e tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:38.486902 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6426e4ce-064a-4fb8-b8b5-8fdee464f09e tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 200 len: 1218 microversion: 2.1 time: 0.118633 Jul 11 14:18:38.491819 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 263/512] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:38 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:38.541312 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-07c556a7-0cdf-466e-91bd-5ca5466c00b1 req-039fe0dc-55bd-4d17-9bc5-37c11020129c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da6649c5-69b0-4e1f-992c-62f13a87ea6d", "name": "network-vif-deleted", "tag": "4fdd29a5-a920-4c2e-933f-1853719c86d8"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:38.549507 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-07c556a7-0cdf-466e-91bd-5ca5466c00b1 req-039fe0dc-55bd-4d17-9bc5-37c11020129c service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:38.549955 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-07c556a7-0cdf-466e-91bd-5ca5466c00b1 req-039fe0dc-55bd-4d17-9bc5-37c11020129c service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:38.564185 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-07c556a7-0cdf-466e-91bd-5ca5466c00b1 req-039fe0dc-55bd-4d17-9bc5-37c11020129c service nova] Creating event network-vif-deleted:4fdd29a5-a920-4c2e-933f-1853719c86d8 for instance da6649c5-69b0-4e1f-992c-62f13a87ea6d on hv-cinder-81914 Jul 11 14:18:38.571426 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-07c556a7-0cdf-466e-91bd-5ca5466c00b1 req-039fe0dc-55bd-4d17-9bc5-37c11020129c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033859 Jul 11 14:18:38.572518 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 250/513] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:18:38.903100 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e3d28f69-731d-41f0-a2d8-c0b857878ab4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:38.903766 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e3d28f69-731d-41f0-a2d8-c0b857878ab4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:38.911593 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d28f69-731d-41f0-a2d8-c0b857878ab4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:38.912322 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d28f69-731d-41f0-a2d8-c0b857878ab4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:38.913101 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d28f69-731d-41f0-a2d8-c0b857878ab4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:38.913700 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d28f69-731d-41f0-a2d8-c0b857878ab4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:38.952741 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d28f69-731d-41f0-a2d8-c0b857878ab4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:38.953185 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d28f69-731d-41f0-a2d8-c0b857878ab4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:38.953632 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-e3d28f69-731d-41f0-a2d8-c0b857878ab4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lazy-loading 'fault' on Instance uuid da6649c5-69b0-4e1f-992c-62f13a87ea6d {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:18:38.997658 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3d28f69-731d-41f0-a2d8-c0b857878ab4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:39.006076 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e3d28f69-731d-41f0-a2d8-c0b857878ab4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 200 len: 1311 microversion: 2.1 time: 0.106862 Jul 11 14:18:39.006681 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 264/514] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:38 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:39.259666 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-618f14e5-77b8-4329-a56a-3cf0447e3993 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:39.260430 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-618f14e5-77b8-4329-a56a-3cf0447e3993 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:39.267251 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-618f14e5-77b8-4329-a56a-3cf0447e3993 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:39.267703 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-618f14e5-77b8-4329-a56a-3cf0447e3993 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:39.268473 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-618f14e5-77b8-4329-a56a-3cf0447e3993 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:39.268913 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-618f14e5-77b8-4329-a56a-3cf0447e3993 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:39.414991 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-618f14e5-77b8-4329-a56a-3cf0447e3993 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:39.423259 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-618f14e5-77b8-4329-a56a-3cf0447e3993 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1567 microversion: 2.1 time: 0.167748 Jul 11 14:18:39.423846 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 251/515] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:39 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:39.459996 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb705e37-2d45-4a86-a289-0fbc7917f66c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:39.460614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cb705e37-2d45-4a86-a289-0fbc7917f66c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:39.466769 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb705e37-2d45-4a86-a289-0fbc7917f66c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:39.467704 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb705e37-2d45-4a86-a289-0fbc7917f66c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:39.468499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb705e37-2d45-4a86-a289-0fbc7917f66c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:39.468934 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb705e37-2d45-4a86-a289-0fbc7917f66c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:39.508213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ee9143d7-403a-4d9d-9e26-2532e3f89caf tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:39.509188 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ee9143d7-403a-4d9d-9e26-2532e3f89caf tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:39.517378 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee9143d7-403a-4d9d-9e26-2532e3f89caf tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:39.517833 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee9143d7-403a-4d9d-9e26-2532e3f89caf tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:39.518660 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee9143d7-403a-4d9d-9e26-2532e3f89caf tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:39.519099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee9143d7-403a-4d9d-9e26-2532e3f89caf tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:39.583503 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ee9143d7-403a-4d9d-9e26-2532e3f89caf tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:39.591257 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ee9143d7-403a-4d9d-9e26-2532e3f89caf tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 200 len: 1214 microversion: 2.1 time: 0.087411 Jul 11 14:18:39.591841 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 252/516] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:39 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:39.602880 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb705e37-2d45-4a86-a289-0fbc7917f66c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:39.611136 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cb705e37-2d45-4a86-a289-0fbc7917f66c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1549 microversion: 2.1 time: 0.155068 Jul 11 14:18:39.611725 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 265/517] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:39 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:39.627620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d6576bfd-271d-40d3-8a43-8e992432ce59 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:39.628400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d6576bfd-271d-40d3-8a43-8e992432ce59 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:39.634308 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d6576bfd-271d-40d3-8a43-8e992432ce59 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:39.634844 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d6576bfd-271d-40d3-8a43-8e992432ce59 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:39.635526 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d6576bfd-271d-40d3-8a43-8e992432ce59 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:39.635967 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d6576bfd-271d-40d3-8a43-8e992432ce59 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:39.716091 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d6576bfd-271d-40d3-8a43-8e992432ce59 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092731 Jul 11 14:18:39.716692 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 253/518] 10.222.0.66 () {58 vars in 1274 bytes} [Mon Jul 11 14:18:39 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:18:40.023758 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8f74ceb9-5bc9-445a-86cc-9276fbedffd1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:40.024735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8f74ceb9-5bc9-445a-86cc-9276fbedffd1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: da6649c5-69b0-4e1f-992c-62f13a87ea6d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:40.034952 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f74ceb9-5bc9-445a-86cc-9276fbedffd1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:40.035697 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f74ceb9-5bc9-445a-86cc-9276fbedffd1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:40.036668 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f74ceb9-5bc9-445a-86cc-9276fbedffd1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:40.037800 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f74ceb9-5bc9-445a-86cc-9276fbedffd1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:40.058924 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-8f74ceb9-5bc9-445a-86cc-9276fbedffd1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] HTTP exception thrown: Instance da6649c5-69b0-4e1f-992c-62f13a87ea6d could not be found. Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8f74ceb9-5bc9-445a-86cc-9276fbedffd1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Request method failure captured: Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d HTTP/1.1 Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDACP6mdhrBbHb9S3XX22Eb0vYXjhp1e_LptzxBkzLwvBvJ1-7gB1TqSdpdJ5YeHgf2tmnMDlqCnoElwnEKtizDSMd2V06J3G6UnMcuGg7PNEVrEt6Rrsspv6l6ei_5BXqbOVaeGYCCinqLdi82bSV7C8J2_OU2nV_ohEovCqh80m6I Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 15d95b0cae244d99885be229335ea541 Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1246670355 Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:18:40.061121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:18:40.062957 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15d95b0cae244d99885be229335ea541"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15d95b0cae244d99885be229335ea541"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15d95b0cae244d99885be229335ea541"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15d95b0cae244d99885be229335ea541"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:18:40.062957 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1246670355 Jul 11 14:18:40.062957 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 15d95b0cae244d99885be229335ea541 Jul 11 14:18:40.062957 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1246670355 Jul 11 14:18:40.062957 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-ServerRescueNegativeTestJSON-1246670355-project Jul 11 14:18:40.062957 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:18:40.062957 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:18:40.062957 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 39a5cea0a591453581a9d98ff796d973 Jul 11 14:18:40.062957 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1246670355-project Jul 11 14:18:40.062957 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:18:40.062957 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance da6649c5-69b0-4e1f-992c-62f13a87ea6d could not be found. Jul 11 14:18:40.062957 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': 'da6649c5-69b0-4e1f-992c-62f13a87ea6d'} Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da6649c5-69b0-4e1f-992c-62f13a87ea6d could not be found. Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:18:40.063724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:18:40.064968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:18:40.064968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:18:40.064968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:18:40.064968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:18:40.064968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:18:40.064968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:18:40.064968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:18:40.064968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da6649c5-69b0-4e1f-992c-62f13a87ea6d could not be found. Jul 11 14:18:40.064968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:18:40.064968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:18:40.064968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:18:40.064968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:18:40.064968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:18:40.064968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:18:40.064968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:18:40.064968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:18:40.064968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da6649c5-69b0-4e1f-992c-62f13a87ea6d could not be found. Jul 11 14:18:40.064968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:18:40.066948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8f74ceb9-5bc9-445a-86cc-9276fbedffd1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Returning 404 to user: Instance da6649c5-69b0-4e1f-992c-62f13a87ea6d could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:18:40.067977 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8f74ceb9-5bc9-445a-86cc-9276fbedffd1 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d" status: 404 len: 111 microversion: 2.1 time: 0.049654 Jul 11 14:18:40.068714 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 266/519] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:40 2022] GET /compute/v2.1/servers/da6649c5-69b0-4e1f-992c-62f13a87ea6d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 14:18:40.079432 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6b7212e5-613c-4e7c-82aa-c17363c06e78 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:40.079954 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6b7212e5-613c-4e7c-82aa-c17363c06e78 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:40.086548 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b7212e5-613c-4e7c-82aa-c17363c06e78 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:40.087007 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b7212e5-613c-4e7c-82aa-c17363c06e78 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:40.087820 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b7212e5-613c-4e7c-82aa-c17363c06e78 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:40.088252 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b7212e5-613c-4e7c-82aa-c17363c06e78 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:40.116062 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6b7212e5-613c-4e7c-82aa-c17363c06e78 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:18:40.195721 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6b7212e5-613c-4e7c-82aa-c17363c06e78 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 204 len: 0 microversion: 2.1 time: 0.122145 Jul 11 14:18:40.196578 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 254/520] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:18:40 2022] DELETE /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:18:40.204920 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-99ce25a2-c4d7-447b-b698-8b8bed9048c4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:40.205548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-99ce25a2-c4d7-447b-b698-8b8bed9048c4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:40.211635 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99ce25a2-c4d7-447b-b698-8b8bed9048c4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:40.212517 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99ce25a2-c4d7-447b-b698-8b8bed9048c4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:40.213311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99ce25a2-c4d7-447b-b698-8b8bed9048c4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:40.213914 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99ce25a2-c4d7-447b-b698-8b8bed9048c4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:40.353175 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-99ce25a2-c4d7-447b-b698-8b8bed9048c4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:40.362692 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-99ce25a2-c4d7-447b-b698-8b8bed9048c4 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.161230 Jul 11 14:18:40.364374 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 267/521] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:40 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:40.442057 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-51becf47-ee52-4fbe-a085-a73cb28fe113 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:40.442759 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-51becf47-ee52-4fbe-a085-a73cb28fe113 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:40.449950 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51becf47-ee52-4fbe-a085-a73cb28fe113 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:40.450662 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51becf47-ee52-4fbe-a085-a73cb28fe113 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:40.451689 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51becf47-ee52-4fbe-a085-a73cb28fe113 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:40.452125 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51becf47-ee52-4fbe-a085-a73cb28fe113 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:40.609301 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-215c3ac0-71a8-4f0e-a5f6-34a2edfe6862 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:40.610096 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-215c3ac0-71a8-4f0e-a5f6-34a2edfe6862 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:40.616412 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-215c3ac0-71a8-4f0e-a5f6-34a2edfe6862 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:40.617143 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-215c3ac0-71a8-4f0e-a5f6-34a2edfe6862 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:40.618117 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-215c3ac0-71a8-4f0e-a5f6-34a2edfe6862 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:40.618754 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-215c3ac0-71a8-4f0e-a5f6-34a2edfe6862 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:40.665331 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-51becf47-ee52-4fbe-a085-a73cb28fe113 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:40.675905 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-51becf47-ee52-4fbe-a085-a73cb28fe113 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1567 microversion: 2.1 time: 0.238690 Jul 11 14:18:40.676806 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 255/522] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:40 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:40.683469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-215c3ac0-71a8-4f0e-a5f6-34a2edfe6862 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:40.691717 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-215c3ac0-71a8-4f0e-a5f6-34a2edfe6862 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 200 len: 1278 microversion: 2.1 time: 0.086720 Jul 11 14:18:40.692393 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 268/523] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:40 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 1278 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:40.783175 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-97e61126-28ae-4607-ab5c-511cd475dfac req-4818dc22-bc40-462b-919d-cf8923ed45bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c2d5cb-d011-4621-90f0-2fac11059be2", "tag": "1eaca124-07e0-4a06-9731-c5df81cfe7c9"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:40.791578 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-97e61126-28ae-4607-ab5c-511cd475dfac req-4818dc22-bc40-462b-919d-cf8923ed45bd service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:40.792103 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-97e61126-28ae-4607-ab5c-511cd475dfac req-4818dc22-bc40-462b-919d-cf8923ed45bd service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:40.803743 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-97e61126-28ae-4607-ab5c-511cd475dfac req-4818dc22-bc40-462b-919d-cf8923ed45bd service nova] Creating event network-changed:1eaca124-07e0-4a06-9731-c5df81cfe7c9 for instance f2c2d5cb-d011-4621-90f0-2fac11059be2 on hv-cinder-81914 Jul 11 14:18:40.808721 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-97e61126-28ae-4607-ab5c-511cd475dfac req-4818dc22-bc40-462b-919d-cf8923ed45bd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029623 Jul 11 14:18:40.809328 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 256/524] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:18:41.381151 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7ad4f086-9939-4521-8b89-cd2afab641f9 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:41.381764 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7ad4f086-9939-4521-8b89-cd2afab641f9 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:41.388288 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7ad4f086-9939-4521-8b89-cd2afab641f9 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:41.388739 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7ad4f086-9939-4521-8b89-cd2afab641f9 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:41.389828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7ad4f086-9939-4521-8b89-cd2afab641f9 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:41.390299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7ad4f086-9939-4521-8b89-cd2afab641f9 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:41.529300 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7ad4f086-9939-4521-8b89-cd2afab641f9 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:41.537834 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7ad4f086-9939-4521-8b89-cd2afab641f9 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.160568 Jul 11 14:18:41.538473 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 269/525] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:41 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:41.694113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ee9bb100-37d0-48ff-a897-cda592b3224e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:41.694840 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ee9bb100-37d0-48ff-a897-cda592b3224e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:41.701057 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee9bb100-37d0-48ff-a897-cda592b3224e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:41.702165 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee9bb100-37d0-48ff-a897-cda592b3224e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:41.703281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee9bb100-37d0-48ff-a897-cda592b3224e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:41.703544 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee9bb100-37d0-48ff-a897-cda592b3224e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:41.708568 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5d11b3b6-c04c-460c-bcf6-3b063898423d tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:41.709185 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5d11b3b6-c04c-460c-bcf6-3b063898423d tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:41.715709 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d11b3b6-c04c-460c-bcf6-3b063898423d tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:41.716159 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d11b3b6-c04c-460c-bcf6-3b063898423d tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:41.716962 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d11b3b6-c04c-460c-bcf6-3b063898423d tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:41.717429 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d11b3b6-c04c-460c-bcf6-3b063898423d tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:41.782824 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5d11b3b6-c04c-460c-bcf6-3b063898423d tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:41.793759 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5d11b3b6-c04c-460c-bcf6-3b063898423d tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 200 len: 1278 microversion: 2.1 time: 0.089079 Jul 11 14:18:41.794706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 270/526] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:41 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 1278 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:41.855209 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ee9bb100-37d0-48ff-a897-cda592b3224e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:41.863510 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ee9bb100-37d0-48ff-a897-cda592b3224e tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1567 microversion: 2.1 time: 0.174139 Jul 11 14:18:41.864085 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 257/527] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:41 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:42.555465 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c7be21a7-7c26-4073-a7a5-75417181e617 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:42.555995 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c7be21a7-7c26-4073-a7a5-75417181e617 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:42.563135 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7be21a7-7c26-4073-a7a5-75417181e617 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:42.563586 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7be21a7-7c26-4073-a7a5-75417181e617 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:42.564358 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7be21a7-7c26-4073-a7a5-75417181e617 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:42.564795 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7be21a7-7c26-4073-a7a5-75417181e617 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:42.703585 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c7be21a7-7c26-4073-a7a5-75417181e617 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:42.711263 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c7be21a7-7c26-4073-a7a5-75417181e617 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.159842 Jul 11 14:18:42.711871 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 271/528] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:42 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:42.811942 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-387172be-adc3-4a20-b891-bd7e2b316812 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:42.812541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-387172be-adc3-4a20-b891-bd7e2b316812 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:42.818576 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-387172be-adc3-4a20-b891-bd7e2b316812 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:42.819024 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-387172be-adc3-4a20-b891-bd7e2b316812 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:42.819784 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-387172be-adc3-4a20-b891-bd7e2b316812 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:42.820220 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-387172be-adc3-4a20-b891-bd7e2b316812 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:42.881173 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6acc5b80-a954-447c-ba2d-b4238097d50a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:42.881908 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6acc5b80-a954-447c-ba2d-b4238097d50a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:42.886857 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-387172be-adc3-4a20-b891-bd7e2b316812 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:42.888195 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6acc5b80-a954-447c-ba2d-b4238097d50a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:42.888720 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6acc5b80-a954-447c-ba2d-b4238097d50a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:42.889594 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6acc5b80-a954-447c-ba2d-b4238097d50a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:42.890197 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6acc5b80-a954-447c-ba2d-b4238097d50a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:42.894225 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-387172be-adc3-4a20-b891-bd7e2b316812 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 200 len: 1278 microversion: 2.1 time: 0.087401 Jul 11 14:18:42.894811 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 258/529] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:42 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:43.022609 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6acc5b80-a954-447c-ba2d-b4238097d50a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:43.031274 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6acc5b80-a954-447c-ba2d-b4238097d50a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1567 microversion: 2.1 time: 0.153928 Jul 11 14:18:43.031875 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 272/530] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:42 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:43.729451 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a90f2e9d-9f9f-4f58-af13-8e50f914d1d2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:43.731065 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a90f2e9d-9f9f-4f58-af13-8e50f914d1d2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:43.739207 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a90f2e9d-9f9f-4f58-af13-8e50f914d1d2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:43.739938 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a90f2e9d-9f9f-4f58-af13-8e50f914d1d2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:43.740886 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a90f2e9d-9f9f-4f58-af13-8e50f914d1d2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:43.741318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a90f2e9d-9f9f-4f58-af13-8e50f914d1d2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:43.878064 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a90f2e9d-9f9f-4f58-af13-8e50f914d1d2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:43.885742 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a90f2e9d-9f9f-4f58-af13-8e50f914d1d2 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1522 microversion: 2.1 time: 0.161113 Jul 11 14:18:43.886277 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 259/531] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:43 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:43.911645 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cdb4b55d-fbd1-4e5b-8267-0d348abf4296 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:43.912269 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cdb4b55d-fbd1-4e5b-8267-0d348abf4296 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:43.918810 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cdb4b55d-fbd1-4e5b-8267-0d348abf4296 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:43.919306 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cdb4b55d-fbd1-4e5b-8267-0d348abf4296 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:43.920829 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cdb4b55d-fbd1-4e5b-8267-0d348abf4296 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:43.921399 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cdb4b55d-fbd1-4e5b-8267-0d348abf4296 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:43.985859 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cdb4b55d-fbd1-4e5b-8267-0d348abf4296 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:43.993589 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cdb4b55d-fbd1-4e5b-8267-0d348abf4296 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 200 len: 1276 microversion: 2.1 time: 0.085786 Jul 11 14:18:43.994212 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 273/532] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:43 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:44.049650 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-81825b6f-a6c1-4f3d-a51b-0537ef65d084 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:44.050425 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-81825b6f-a6c1-4f3d-a51b-0537ef65d084 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:44.056733 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81825b6f-a6c1-4f3d-a51b-0537ef65d084 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:44.057790 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81825b6f-a6c1-4f3d-a51b-0537ef65d084 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:44.058606 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81825b6f-a6c1-4f3d-a51b-0537ef65d084 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:44.059338 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81825b6f-a6c1-4f3d-a51b-0537ef65d084 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:44.320968 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-81825b6f-a6c1-4f3d-a51b-0537ef65d084 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:44.331863 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-81825b6f-a6c1-4f3d-a51b-0537ef65d084 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1567 microversion: 2.1 time: 0.286836 Jul 11 14:18:44.332592 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 260/533] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:44 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1567 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:44.844596 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-1aca2459-9292-4a18-a96e-f4682ce7193e req-85596b0e-e9bf-4187-b1ea-a1d136712e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9c0371-22ec-432a-9835-696bc61b05de", "name": "network-vif-deleted", "tag": "cc6828e4-dd29-4d09-af39-cc7013ef4ce3"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:44.859061 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1aca2459-9292-4a18-a96e-f4682ce7193e req-85596b0e-e9bf-4187-b1ea-a1d136712e58 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:44.859654 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1aca2459-9292-4a18-a96e-f4682ce7193e req-85596b0e-e9bf-4187-b1ea-a1d136712e58 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:44.871966 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-1aca2459-9292-4a18-a96e-f4682ce7193e req-85596b0e-e9bf-4187-b1ea-a1d136712e58 service nova] Creating event network-vif-deleted:cc6828e4-dd29-4d09-af39-cc7013ef4ce3 for instance ce9c0371-22ec-432a-9835-696bc61b05de on hv-cinder-81914 Jul 11 14:18:44.880961 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-1aca2459-9292-4a18-a96e-f4682ce7193e req-85596b0e-e9bf-4187-b1ea-a1d136712e58 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038435 Jul 11 14:18:44.884462 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 274/534] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:18:44.903387 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-965bc26c-d60d-495f-a002-c4c956d2cc00 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:44.903915 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-965bc26c-d60d-495f-a002-c4c956d2cc00 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:44.912157 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-965bc26c-d60d-495f-a002-c4c956d2cc00 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:44.912608 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-965bc26c-d60d-495f-a002-c4c956d2cc00 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:44.913439 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-965bc26c-d60d-495f-a002-c4c956d2cc00 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:44.913825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-965bc26c-d60d-495f-a002-c4c956d2cc00 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:44.985247 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-965bc26c-d60d-495f-a002-c4c956d2cc00 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a5cea0a591453581a9d98ff796d973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d95b0cae244d99885be229335ea541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:44.993757 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-965bc26c-d60d-495f-a002-c4c956d2cc00 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 200 len: 1307 microversion: 2.1 time: 0.094170 Jul 11 14:18:44.993917 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 261/535] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:44 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:45.013297 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f9cec523-1a01-4e61-94d1-78a5c16a8d5a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:45.014426 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f9cec523-1a01-4e61-94d1-78a5c16a8d5a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:45.020784 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9cec523-1a01-4e61-94d1-78a5c16a8d5a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:45.021232 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9cec523-1a01-4e61-94d1-78a5c16a8d5a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:45.022007 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9cec523-1a01-4e61-94d1-78a5c16a8d5a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:45.022467 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9cec523-1a01-4e61-94d1-78a5c16a8d5a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:45.026715 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:45.236624 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f9cec523-1a01-4e61-94d1-78a5c16a8d5a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:45.246263 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f9cec523-1a01-4e61-94d1-78a5c16a8d5a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 200 len: 1318 microversion: 2.1 time: 0.237505 Jul 11 14:18:45.247147 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 275/536] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:45 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:45.350327 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e9fe9571-257b-47fc-944d-e98b3110dfc7 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:45.351265 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e9fe9571-257b-47fc-944d-e98b3110dfc7 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:45.358234 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e9fe9571-257b-47fc-944d-e98b3110dfc7 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:45.358830 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e9fe9571-257b-47fc-944d-e98b3110dfc7 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:45.359717 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e9fe9571-257b-47fc-944d-e98b3110dfc7 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:45.360345 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e9fe9571-257b-47fc-944d-e98b3110dfc7 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:45.507575 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e9fe9571-257b-47fc-944d-e98b3110dfc7 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:45.518864 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e9fe9571-257b-47fc-944d-e98b3110dfc7 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1567 microversion: 2.1 time: 0.172372 Jul 11 14:18:45.519880 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 262/537] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:45 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:45.777179 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-73ed5fde-7b10-44ca-ba50-24fbab8ea7c9 req-45cc2e48-23cb-4377-bc90-994d4d3d92ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "947f4a70-daac-4e48-9891-235b34895d99", "tag": "008fa0a7-8c6e-4fc2-b49a-18d3b184a439"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:45.788020 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-73ed5fde-7b10-44ca-ba50-24fbab8ea7c9 req-45cc2e48-23cb-4377-bc90-994d4d3d92ad service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:45.788485 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-73ed5fde-7b10-44ca-ba50-24fbab8ea7c9 req-45cc2e48-23cb-4377-bc90-994d4d3d92ad service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:45.801439 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-73ed5fde-7b10-44ca-ba50-24fbab8ea7c9 req-45cc2e48-23cb-4377-bc90-994d4d3d92ad service nova] Creating event network-changed:008fa0a7-8c6e-4fc2-b49a-18d3b184a439 for instance 947f4a70-daac-4e48-9891-235b34895d99 on hv-cinder-81914 Jul 11 14:18:45.806430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-73ed5fde-7b10-44ca-ba50-24fbab8ea7c9 req-45cc2e48-23cb-4377-bc90-994d4d3d92ad service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032963 Jul 11 14:18:45.807055 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 276/538] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:18:46.013175 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c295fb8c-ca5d-4d3f-b25c-d3e6f97d9d18 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:46.014378 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c295fb8c-ca5d-4d3f-b25c-d3e6f97d9d18 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] [instance: ce9c0371-22ec-432a-9835-696bc61b05de] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:46.025961 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c295fb8c-ca5d-4d3f-b25c-d3e6f97d9d18 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:46.026742 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c295fb8c-ca5d-4d3f-b25c-d3e6f97d9d18 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:46.027990 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c295fb8c-ca5d-4d3f-b25c-d3e6f97d9d18 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:46.028440 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c295fb8c-ca5d-4d3f-b25c-d3e6f97d9d18 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:46.034806 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:46.045707 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-c295fb8c-ca5d-4d3f-b25c-d3e6f97d9d18 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] HTTP exception thrown: Instance ce9c0371-22ec-432a-9835-696bc61b05de could not be found. Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c295fb8c-ca5d-4d3f-b25c-d3e6f97d9d18 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Request method failure captured: Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de HTTP/1.1 Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDACP6mdhrBbHb9S3XX22Eb0vYXjhp1e_LptzxBkzLwvBvJ1-7gB1TqSdpdJ5YeHgf2tmnMDlqCnoElwnEKtizDSMd2V06J3G6UnMcuGg7PNEVrEt6Rrsspv6l6ei_5BXqbOVaeGYCCinqLdi82bSV7C8J2_OU2nV_ohEovCqh80m6I Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 15d95b0cae244d99885be229335ea541 Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1246670355 Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:18:46.047481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:18:46.049075 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15d95b0cae244d99885be229335ea541"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15d95b0cae244d99885be229335ea541"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15d95b0cae244d99885be229335ea541"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15d95b0cae244d99885be229335ea541"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:18:46.049075 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1246670355 Jul 11 14:18:46.049075 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 15d95b0cae244d99885be229335ea541 Jul 11 14:18:46.049075 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1246670355 Jul 11 14:18:46.049075 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-ServerRescueNegativeTestJSON-1246670355-project Jul 11 14:18:46.049075 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:18:46.049075 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:18:46.049075 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 39a5cea0a591453581a9d98ff796d973 Jul 11 14:18:46.049075 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1246670355-project Jul 11 14:18:46.049075 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:18:46.049075 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance ce9c0371-22ec-432a-9835-696bc61b05de could not be found. Jul 11 14:18:46.049075 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': 'ce9c0371-22ec-432a-9835-696bc61b05de'} Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce9c0371-22ec-432a-9835-696bc61b05de could not be found. Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:18:46.049944 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:18:46.051403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:18:46.051403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:18:46.051403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:18:46.051403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:18:46.051403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:18:46.051403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:18:46.051403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:18:46.051403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce9c0371-22ec-432a-9835-696bc61b05de could not be found. Jul 11 14:18:46.051403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:18:46.051403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:18:46.051403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:18:46.051403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:18:46.051403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:18:46.051403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:18:46.051403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:18:46.051403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:18:46.051403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce9c0371-22ec-432a-9835-696bc61b05de could not be found. Jul 11 14:18:46.051403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:18:46.052689 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c295fb8c-ca5d-4d3f-b25c-d3e6f97d9d18 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] Returning 404 to user: Instance ce9c0371-22ec-432a-9835-696bc61b05de could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:18:46.052689 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c295fb8c-ca5d-4d3f-b25c-d3e6f97d9d18 tempest-ServerRescueNegativeTestJSON-1246670355 tempest-ServerRescueNegativeTestJSON-1246670355-project] 10.222.0.66 "GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de" status: 404 len: 111 microversion: 2.1 time: 0.039676 Jul 11 14:18:46.052689 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 263/539] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:46 2022] GET /compute/v2.1/servers/ce9c0371-22ec-432a-9835-696bc61b05de => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:18:46.266250 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2fe8851b-a40b-4f53-88de-05124392ca28 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:46.266875 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2fe8851b-a40b-4f53-88de-05124392ca28 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:46.273404 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2fe8851b-a40b-4f53-88de-05124392ca28 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:46.273860 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2fe8851b-a40b-4f53-88de-05124392ca28 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:46.274680 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2fe8851b-a40b-4f53-88de-05124392ca28 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:46.275126 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2fe8851b-a40b-4f53-88de-05124392ca28 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:46.510654 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2fe8851b-a40b-4f53-88de-05124392ca28 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:46.519224 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2fe8851b-a40b-4f53-88de-05124392ca28 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 200 len: 1318 microversion: 2.1 time: 0.258354 Jul 11 14:18:46.519941 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 277/540] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:46 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:46.536693 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-50542b16-9221-4259-bd6f-d7446b49a044 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:46.537407 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-50542b16-9221-4259-bd6f-d7446b49a044 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:46.545127 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50542b16-9221-4259-bd6f-d7446b49a044 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:46.545578 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50542b16-9221-4259-bd6f-d7446b49a044 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:46.546559 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50542b16-9221-4259-bd6f-d7446b49a044 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:46.546903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50542b16-9221-4259-bd6f-d7446b49a044 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:46.686524 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-50542b16-9221-4259-bd6f-d7446b49a044 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:46.695920 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-50542b16-9221-4259-bd6f-d7446b49a044 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1567 microversion: 2.1 time: 0.162868 Jul 11 14:18:46.696541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 264/541] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:46 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:47.536664 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4927c494-933c-4d1f-b2f4-16f79f4b9da5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:47.537535 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4927c494-933c-4d1f-b2f4-16f79f4b9da5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:47.546844 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4927c494-933c-4d1f-b2f4-16f79f4b9da5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:47.547340 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4927c494-933c-4d1f-b2f4-16f79f4b9da5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:47.548890 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4927c494-933c-4d1f-b2f4-16f79f4b9da5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:47.549356 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4927c494-933c-4d1f-b2f4-16f79f4b9da5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:47.714326 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d44d616b-1802-46df-a6d0-a064483aaa86 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:47.714946 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d44d616b-1802-46df-a6d0-a064483aaa86 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:47.722460 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d44d616b-1802-46df-a6d0-a064483aaa86 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:47.722909 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d44d616b-1802-46df-a6d0-a064483aaa86 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:47.723690 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d44d616b-1802-46df-a6d0-a064483aaa86 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:47.724125 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d44d616b-1802-46df-a6d0-a064483aaa86 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:47.864256 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d44d616b-1802-46df-a6d0-a064483aaa86 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:47.872275 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d44d616b-1802-46df-a6d0-a064483aaa86 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1567 microversion: 2.1 time: 0.161764 Jul 11 14:18:47.873595 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 265/542] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:47 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:47.894893 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4927c494-933c-4d1f-b2f4-16f79f4b9da5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:47.902570 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4927c494-933c-4d1f-b2f4-16f79f4b9da5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 200 len: 1318 microversion: 2.1 time: 0.370337 Jul 11 14:18:47.903233 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 278/543] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:47 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:48.891548 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9e80a23b-130d-4c96-8237-ae96559e4750 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:48.892479 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9e80a23b-130d-4c96-8237-ae96559e4750 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:48.901368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e80a23b-130d-4c96-8237-ae96559e4750 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:48.902622 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e80a23b-130d-4c96-8237-ae96559e4750 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:48.903850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e80a23b-130d-4c96-8237-ae96559e4750 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:48.905344 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e80a23b-130d-4c96-8237-ae96559e4750 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:48.919668 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e0356862-48df-4965-8eb0-573c1fda59a9 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:48.921315 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e0356862-48df-4965-8eb0-573c1fda59a9 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:48.924137 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:48.924813 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=8 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:48.939743 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0356862-48df-4965-8eb0-573c1fda59a9 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:48.940198 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0356862-48df-4965-8eb0-573c1fda59a9 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:48.941006 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0356862-48df-4965-8eb0-573c1fda59a9 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:48.941447 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0356862-48df-4965-8eb0-573c1fda59a9 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:49.109893 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9e80a23b-130d-4c96-8237-ae96559e4750 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:49.119055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9e80a23b-130d-4c96-8237-ae96559e4750 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1567 microversion: 2.1 time: 0.232440 Jul 11 14:18:49.125427 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 266/544] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:48 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:49.592853 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e0356862-48df-4965-8eb0-573c1fda59a9 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:49.601776 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e0356862-48df-4965-8eb0-573c1fda59a9 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 200 len: 1318 microversion: 2.1 time: 0.685817 Jul 11 14:18:49.611647 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 279/545] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:48 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 1318 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:50.137055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-04466d67-147e-44ae-936a-a629d33cc175 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:50.137690 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-04466d67-147e-44ae-936a-a629d33cc175 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:50.145323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04466d67-147e-44ae-936a-a629d33cc175 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:50.145774 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04466d67-147e-44ae-936a-a629d33cc175 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:50.146591 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04466d67-147e-44ae-936a-a629d33cc175 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:50.147032 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04466d67-147e-44ae-936a-a629d33cc175 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:50.316615 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-04466d67-147e-44ae-936a-a629d33cc175 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:50.324414 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-04466d67-147e-44ae-936a-a629d33cc175 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1567 microversion: 2.1 time: 0.191406 Jul 11 14:18:50.325136 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 267/546] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:50 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:50.619728 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-02d82003-abab-44b1-aab7-7871c3b127c5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:50.620476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-02d82003-abab-44b1-aab7-7871c3b127c5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:50.628978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02d82003-abab-44b1-aab7-7871c3b127c5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:50.629530 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02d82003-abab-44b1-aab7-7871c3b127c5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:50.630441 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02d82003-abab-44b1-aab7-7871c3b127c5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:50.630987 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02d82003-abab-44b1-aab7-7871c3b127c5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:50.824371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-02d82003-abab-44b1-aab7-7871c3b127c5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:50.833038 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-02d82003-abab-44b1-aab7-7871c3b127c5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 200 len: 1318 microversion: 2.1 time: 0.217818 Jul 11 14:18:50.833626 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 280/547] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:50 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:51.126679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-b77ca336-82f0-4979-9866-d0fd77c332f9 req-1aff812a-ca21-424e-8baa-7fa7a7a9f632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947f4a70-daac-4e48-9891-235b34895d99", "name": "network-vif-plugged", "status": "completed", "tag": "008fa0a7-8c6e-4fc2-b49a-18d3b184a439"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:51.144816 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-b77ca336-82f0-4979-9866-d0fd77c332f9 req-1aff812a-ca21-424e-8baa-7fa7a7a9f632 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:51.145457 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-b77ca336-82f0-4979-9866-d0fd77c332f9 req-1aff812a-ca21-424e-8baa-7fa7a7a9f632 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:51.157149 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-b77ca336-82f0-4979-9866-d0fd77c332f9 req-1aff812a-ca21-424e-8baa-7fa7a7a9f632 service nova] Creating event network-vif-plugged:008fa0a7-8c6e-4fc2-b49a-18d3b184a439 for instance 947f4a70-daac-4e48-9891-235b34895d99 on hv-cinder-81914 Jul 11 14:18:51.162892 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-b77ca336-82f0-4979-9866-d0fd77c332f9 req-1aff812a-ca21-424e-8baa-7fa7a7a9f632 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041257 Jul 11 14:18:51.163627 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 268/548] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:18:51.344292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-421d0ed1-c63b-4331-bb0b-1be94751199f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:51.344918 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-421d0ed1-c63b-4331-bb0b-1be94751199f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:51.351425 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-421d0ed1-c63b-4331-bb0b-1be94751199f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:51.352225 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-421d0ed1-c63b-4331-bb0b-1be94751199f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:51.353530 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-421d0ed1-c63b-4331-bb0b-1be94751199f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:51.353975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-421d0ed1-c63b-4331-bb0b-1be94751199f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:51.536641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-421d0ed1-c63b-4331-bb0b-1be94751199f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:51.547266 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-421d0ed1-c63b-4331-bb0b-1be94751199f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1567 microversion: 2.1 time: 0.207352 Jul 11 14:18:51.547864 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 281/549] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:51 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:51.851249 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f2cddf76-9a30-4024-8119-ef53ca9df259 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:51.851953 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f2cddf76-9a30-4024-8119-ef53ca9df259 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:51.858851 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f2cddf76-9a30-4024-8119-ef53ca9df259 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:51.859290 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f2cddf76-9a30-4024-8119-ef53ca9df259 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:51.860059 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f2cddf76-9a30-4024-8119-ef53ca9df259 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:51.860487 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f2cddf76-9a30-4024-8119-ef53ca9df259 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:52.006737 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f2cddf76-9a30-4024-8119-ef53ca9df259 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:52.021681 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f2cddf76-9a30-4024-8119-ef53ca9df259 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 200 len: 1318 microversion: 2.1 time: 0.174693 Jul 11 14:18:52.022594 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 269/550] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:51 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:52.568399 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a16a0253-ca3b-4279-9c7b-99c1fc64b56c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:52.569703 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a16a0253-ca3b-4279-9c7b-99c1fc64b56c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:52.579813 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a16a0253-ca3b-4279-9c7b-99c1fc64b56c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:52.580373 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a16a0253-ca3b-4279-9c7b-99c1fc64b56c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:52.581400 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a16a0253-ca3b-4279-9c7b-99c1fc64b56c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:52.582042 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a16a0253-ca3b-4279-9c7b-99c1fc64b56c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:52.791414 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a16a0253-ca3b-4279-9c7b-99c1fc64b56c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:52.800619 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a16a0253-ca3b-4279-9c7b-99c1fc64b56c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1567 microversion: 2.1 time: 0.236844 Jul 11 14:18:52.801209 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 282/551] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:52 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:53.039321 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9f2d1d91-3ffd-4973-aff6-c23e2e460ab5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:53.039881 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9f2d1d91-3ffd-4973-aff6-c23e2e460ab5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:53.047316 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f2d1d91-3ffd-4973-aff6-c23e2e460ab5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:53.048114 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f2d1d91-3ffd-4973-aff6-c23e2e460ab5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:53.049092 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f2d1d91-3ffd-4973-aff6-c23e2e460ab5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:53.049596 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f2d1d91-3ffd-4973-aff6-c23e2e460ab5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:53.343936 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9f2d1d91-3ffd-4973-aff6-c23e2e460ab5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:53.353066 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9f2d1d91-3ffd-4973-aff6-c23e2e460ab5 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 200 len: 1507 microversion: 2.1 time: 0.317879 Jul 11 14:18:53.361139 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 270/552] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:53 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 1507 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:53.386306 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1a4beb21-8223-40e2-948c-c3885b2ff5a8 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f87ae22c-5cc1-4ae1-93e1-b0ea14911578", "device": "/dev/sdb"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:53.387620 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1a4beb21-8223-40e2-948c-c3885b2ff5a8 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:53.403091 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a4beb21-8223-40e2-948c-c3885b2ff5a8 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:53.404888 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a4beb21-8223-40e2-948c-c3885b2ff5a8 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:53.406102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a4beb21-8223-40e2-948c-c3885b2ff5a8 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:53.406959 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a4beb21-8223-40e2-948c-c3885b2ff5a8 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:53.822797 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c9512e50-cc47-4f05-a83e-315fc754217d tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:53.824076 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c9512e50-cc47-4f05-a83e-315fc754217d tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:53.842819 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c9512e50-cc47-4f05-a83e-315fc754217d tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:53.846340 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c9512e50-cc47-4f05-a83e-315fc754217d tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:53.850229 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c9512e50-cc47-4f05-a83e-315fc754217d tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:53.852793 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c9512e50-cc47-4f05-a83e-315fc754217d tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:53.853632 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1a4beb21-8223-40e2-948c-c3885b2ff5a8 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "POST /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.472275 Jul 11 14:18:53.858602 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 283/553] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 11 14:18:53 2022] POST /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99/os-volume_attachments => generated 194 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:18:54.168761 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c9512e50-cc47-4f05-a83e-315fc754217d tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:54.190993 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c9512e50-cc47-4f05-a83e-315fc754217d tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1567 microversion: 2.1 time: 0.375387 Jul 11 14:18:54.191891 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 271/554] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:53 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1567 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:55.209722 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-29ff1f7c-edaf-416a-85e1-e7dc51adcf53 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:55.210985 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-29ff1f7c-edaf-416a-85e1-e7dc51adcf53 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:55.223189 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29ff1f7c-edaf-416a-85e1-e7dc51adcf53 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:55.224765 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29ff1f7c-edaf-416a-85e1-e7dc51adcf53 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:55.225753 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29ff1f7c-edaf-416a-85e1-e7dc51adcf53 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:55.226242 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29ff1f7c-edaf-416a-85e1-e7dc51adcf53 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:55.468379 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-29ff1f7c-edaf-416a-85e1-e7dc51adcf53 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:55.477356 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-29ff1f7c-edaf-416a-85e1-e7dc51adcf53 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1567 microversion: 2.1 time: 0.272119 Jul 11 14:18:55.478303 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 284/555] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:55 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1567 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:56.281251 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fe260d4e-e5e2-4a82-87b7-fba0544f5863 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Action: 'create', calling method: .version_select at 0x7fc976c16700>, body: {"keypair": {"name": "tempest-keypair-165752955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACuW0zkFSeuH0Xp/uUJleTB+qfpStX+n7cghoAKpIgJ1/8WjfJ4pDFTN89yuctxPPMmU4xapNZNGZceQiKyT1lVIPXsDFoMPtmCGQBZNGD11jXK4JWyKZOkwpJkK8H4Mg=="}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:56.295877 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-fe260d4e-e5e2-4a82-87b7-fba0544f5863 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Getting quotas for project 4463cb0c8f5d473f955e0f08eb7b4e7f. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:18:56.300379 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-fe260d4e-e5e2-4a82-87b7-fba0544f5863 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Getting quotas for user 999bc8975c43406c838e5c4bb2af1e53 and project 4463cb0c8f5d473f955e0f08eb7b4e7f. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:18:56.337671 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fe260d4e-e5e2-4a82-87b7-fba0544f5863 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.197719 Jul 11 14:18:56.338331 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 272/556] 10.222.0.66 () {62 vars in 1199 bytes} [Mon Jul 11 14:18:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 199 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 11 14:18:56.498571 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2252c2e4-e894-4a6f-9d24-c891cac12d16 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:56.499198 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2252c2e4-e894-4a6f-9d24-c891cac12d16 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:56.509014 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2252c2e4-e894-4a6f-9d24-c891cac12d16 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:56.509014 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2252c2e4-e894-4a6f-9d24-c891cac12d16 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:56.509014 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2252c2e4-e894-4a6f-9d24-c891cac12d16 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:56.509354 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2252c2e4-e894-4a6f-9d24-c891cac12d16 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:56.720233 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2252c2e4-e894-4a6f-9d24-c891cac12d16 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:56.730541 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2252c2e4-e894-4a6f-9d24-c891cac12d16 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1568 microversion: 2.1 time: 0.237917 Jul 11 14:18:56.731317 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 285/557] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:56 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:56.755653 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7f6af493-358b-492c-96a9-bf2413ae6d04 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:56.756571 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7f6af493-358b-492c-96a9-bf2413ae6d04 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:56.772847 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f6af493-358b-492c-96a9-bf2413ae6d04 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:56.774021 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f6af493-358b-492c-96a9-bf2413ae6d04 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:56.774969 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f6af493-358b-492c-96a9-bf2413ae6d04 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:56.775509 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f6af493-358b-492c-96a9-bf2413ae6d04 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:56.970608 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7f6af493-358b-492c-96a9-bf2413ae6d04 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "POST /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561/action" status: 202 len: 0 microversion: 2.1 time: 0.223924 Jul 11 14:18:56.971871 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 273/558] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 11 14:18:56 2022] POST /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:18:56.980828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3cb17d74-7345-4c7a-a2aa-6937e14b2b52 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:56.982309 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3cb17d74-7345-4c7a-a2aa-6937e14b2b52 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:56.993641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:56.996388 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3cb17d74-7345-4c7a-a2aa-6937e14b2b52 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:56.996840 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3cb17d74-7345-4c7a-a2aa-6937e14b2b52 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:56.998663 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3cb17d74-7345-4c7a-a2aa-6937e14b2b52 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:56.999341 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3cb17d74-7345-4c7a-a2aa-6937e14b2b52 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:57.204767 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-99a6b1de-6cbd-4b77-921c-959d7e0bd5d6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:57.205618 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-99a6b1de-6cbd-4b77-921c-959d7e0bd5d6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:57.223616 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99a6b1de-6cbd-4b77-921c-959d7e0bd5d6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:57.224243 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99a6b1de-6cbd-4b77-921c-959d7e0bd5d6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:57.225177 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99a6b1de-6cbd-4b77-921c-959d7e0bd5d6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:57.225870 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99a6b1de-6cbd-4b77-921c-959d7e0bd5d6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:57.265137 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-99a6b1de-6cbd-4b77-921c-959d7e0bd5d6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:18:57.276549 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3cb17d74-7345-4c7a-a2aa-6937e14b2b52 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:57.285452 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3cb17d74-7345-4c7a-a2aa-6937e14b2b52 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1516 microversion: 2.1 time: 0.308575 Jul 11 14:18:57.290628 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 286/559] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:56 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1516 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:57.396285 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-99a6b1de-6cbd-4b77-921c-959d7e0bd5d6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 204 len: 0 microversion: 2.1 time: 0.199504 Jul 11 14:18:57.398862 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 274/560] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:18:57 2022] DELETE /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 11 14:18:57.409060 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b841ad1d-3b0e-4ddf-8811-a2a0e37ab6b5 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:57.409669 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b841ad1d-3b0e-4ddf-8811-a2a0e37ab6b5 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:57.416308 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b841ad1d-3b0e-4ddf-8811-a2a0e37ab6b5 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:57.416771 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b841ad1d-3b0e-4ddf-8811-a2a0e37ab6b5 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:57.418531 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b841ad1d-3b0e-4ddf-8811-a2a0e37ab6b5 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:57.419261 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b841ad1d-3b0e-4ddf-8811-a2a0e37ab6b5 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:57.885630 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b841ad1d-3b0e-4ddf-8811-a2a0e37ab6b5 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:57.894856 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b841ad1d-3b0e-4ddf-8811-a2a0e37ab6b5 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1577 microversion: 2.1 time: 0.491964 Jul 11 14:18:57.895443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 287/561] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:57 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1577 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:58.081870 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-39797df8-b3c5-41e6-a711-db278e93b7ff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-739600442", "imageRef": "67874ac7-fac8-4d6d-9cd1-9091ecb957b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18750740-4061-422d-a7cb-f13aa63e24aa"}], "security_groups": [{"name": "tempest-securitygroup--667528143"}], "key_name": "tempest-keypair-165752955", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:58.195180 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-39797df8-b3c5-41e6-a711-db278e93b7ff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] validate_networks() for [('18750740-4061-422d-a7cb-f13aa63e24aa', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:18:58.312125 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ea56a2f0-46dd-4212-a9fe-91edc1cbb1eb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:58.313037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ea56a2f0-46dd-4212-a9fe-91edc1cbb1eb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:58.320661 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea56a2f0-46dd-4212-a9fe-91edc1cbb1eb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:58.321112 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea56a2f0-46dd-4212-a9fe-91edc1cbb1eb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:58.322212 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea56a2f0-46dd-4212-a9fe-91edc1cbb1eb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:58.323030 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea56a2f0-46dd-4212-a9fe-91edc1cbb1eb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:58.468438 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ea56a2f0-46dd-4212-a9fe-91edc1cbb1eb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:58.476296 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ea56a2f0-46dd-4212-a9fe-91edc1cbb1eb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1516 microversion: 2.1 time: 0.170693 Jul 11 14:18:58.476875 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 288/562] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:58 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:58.605455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-39797df8-b3c5-41e6-a711-db278e93b7ff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:18:58.605972 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-39797df8-b3c5-41e6-a711-db278e93b7ff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:18:58.607806 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-39797df8-b3c5-41e6-a711-db278e93b7ff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:18:58.608302 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-39797df8-b3c5-41e6-a711-db278e93b7ff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:18:58.608982 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-39797df8-b3c5-41e6-a711-db278e93b7ff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:18:58.620296 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-39797df8-b3c5-41e6-a711-db278e93b7ff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:58.620813 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-39797df8-b3c5-41e6-a711-db278e93b7ff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:58.621660 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-39797df8-b3c5-41e6-a711-db278e93b7ff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:58.622333 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-39797df8-b3c5-41e6-a711-db278e93b7ff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:58.641506 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-39797df8-b3c5-41e6-a711-db278e93b7ff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Getting quotas for project 4463cb0c8f5d473f955e0f08eb7b4e7f. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:18:58.645776 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-39797df8-b3c5-41e6-a711-db278e93b7ff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Getting quotas for user 999bc8975c43406c838e5c4bb2af1e53 and project 4463cb0c8f5d473f955e0f08eb7b4e7f. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:18:58.656634 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:58.659550 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-39797df8-b3c5-41e6-a711-db278e93b7ff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:18:58.662420 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-39797df8-b3c5-41e6-a711-db278e93b7ff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67874ac7-fac8-4d6d-9cd1-9091ecb957b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:18:58.726206 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-39797df8-b3c5-41e6-a711-db278e93b7ff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.648937 Jul 11 14:18:58.726787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 275/563] 10.222.0.66 () {62 vars in 1187 bytes} [Mon Jul 11 14:18:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 11 14:18:58.736980 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5a30ac4e-dd17-4c92-8ed5-0e1bf17e75aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:58.744117 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5a30ac4e-dd17-4c92-8ed5-0e1bf17e75aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:58.808753 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5a30ac4e-dd17-4c92-8ed5-0e1bf17e75aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:58.817521 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5a30ac4e-dd17-4c92-8ed5-0e1bf17e75aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:58.819063 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5a30ac4e-dd17-4c92-8ed5-0e1bf17e75aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:58.820236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5a30ac4e-dd17-4c92-8ed5-0e1bf17e75aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1280 microversion: 2.20 time: 0.087305 Jul 11 14:18:58.820793 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 289/564] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:18:58 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:18:58.912814 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7ef5b3b6-7619-47b0-8a3e-f72e20f125dc tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:58.913919 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7ef5b3b6-7619-47b0-8a3e-f72e20f125dc tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:58.925006 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ef5b3b6-7619-47b0-8a3e-f72e20f125dc tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:58.927467 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ef5b3b6-7619-47b0-8a3e-f72e20f125dc tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:58.929465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ef5b3b6-7619-47b0-8a3e-f72e20f125dc tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:58.931111 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ef5b3b6-7619-47b0-8a3e-f72e20f125dc tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:59.132018 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7ef5b3b6-7619-47b0-8a3e-f72e20f125dc tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:59.142396 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7ef5b3b6-7619-47b0-8a3e-f72e20f125dc tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1577 microversion: 2.1 time: 0.233464 Jul 11 14:18:59.153202 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 276/565] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:58 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1577 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:59.213002 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-d4fb5044-b8b3-4003-993b-7be36cc3f7e7 req-d169ac71-235a-44e0-8c06-753139d97819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374e3321-9408-4c7b-b2c3-8be5d7ed6561", "name": "network-vif-unplugged", "status": "completed", "tag": "6d373871-6631-4afb-9527-c160464851a2"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:59.225382 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d4fb5044-b8b3-4003-993b-7be36cc3f7e7 req-d169ac71-235a-44e0-8c06-753139d97819 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:59.225903 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d4fb5044-b8b3-4003-993b-7be36cc3f7e7 req-d169ac71-235a-44e0-8c06-753139d97819 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:59.238025 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.compute.server_external_events [req-d4fb5044-b8b3-4003-993b-7be36cc3f7e7 req-d169ac71-235a-44e0-8c06-753139d97819 service nova] Unable to find a host for instance 374e3321-9408-4c7b-b2c3-8be5d7ed6561. Dropping event network-vif-unplugged {{(pid=117920) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 11 14:18:59.239150 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-d4fb5044-b8b3-4003-993b-7be36cc3f7e7 req-d169ac71-235a-44e0-8c06-753139d97819 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.118405 Jul 11 14:18:59.239756 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 290/566] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 120 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 11 14:18:59.494997 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2420f937-f9c5-4739-81b8-7eacc4286813 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:59.495861 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2420f937-f9c5-4739-81b8-7eacc4286813 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:59.516263 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2420f937-f9c5-4739-81b8-7eacc4286813 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:59.516743 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2420f937-f9c5-4739-81b8-7eacc4286813 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:59.517713 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2420f937-f9c5-4739-81b8-7eacc4286813 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:59.518450 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2420f937-f9c5-4739-81b8-7eacc4286813 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:59.711052 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2420f937-f9c5-4739-81b8-7eacc4286813 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:59.720513 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2420f937-f9c5-4739-81b8-7eacc4286813 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1518 microversion: 2.1 time: 0.230568 Jul 11 14:18:59.727469 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 277/567] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:59 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1518 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:59.838967 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-375a146a-ed8d-4088-bb70-87ff20f19765 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:59.839711 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-375a146a-ed8d-4088-bb70-87ff20f19765 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:59.851275 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-375a146a-ed8d-4088-bb70-87ff20f19765 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:59.851720 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-375a146a-ed8d-4088-bb70-87ff20f19765 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:59.856310 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-375a146a-ed8d-4088-bb70-87ff20f19765 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:59.856310 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-375a146a-ed8d-4088-bb70-87ff20f19765 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:59.965437 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-375a146a-ed8d-4088-bb70-87ff20f19765 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:59.988595 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-375a146a-ed8d-4088-bb70-87ff20f19765 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:00.001594 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-375a146a-ed8d-4088-bb70-87ff20f19765 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:00.003043 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-375a146a-ed8d-4088-bb70-87ff20f19765 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1332 microversion: 2.20 time: 0.168105 Jul 11 14:19:00.004098 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 291/568] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:18:59 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1332 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:19:00.162270 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-02e5223a-3644-46b1-a140-86534c3fc47c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:00.163496 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-02e5223a-3644-46b1-a140-86534c3fc47c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:00.176685 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-02e5223a-3644-46b1-a140-86534c3fc47c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:00.180833 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-02e5223a-3644-46b1-a140-86534c3fc47c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:00.181904 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-02e5223a-3644-46b1-a140-86534c3fc47c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:00.182370 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-02e5223a-3644-46b1-a140-86534c3fc47c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:00.269437 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-02e5223a-3644-46b1-a140-86534c3fc47c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:00.277937 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-02e5223a-3644-46b1-a140-86534c3fc47c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1510 microversion: 2.1 time: 0.120875 Jul 11 14:19:00.279124 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 278/569] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:00 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1510 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:00.746939 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-00bd9c56-dd65-4248-9c95-0f384d11e5fc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:00.747859 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-00bd9c56-dd65-4248-9c95-0f384d11e5fc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:00.761531 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00bd9c56-dd65-4248-9c95-0f384d11e5fc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:00.763585 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00bd9c56-dd65-4248-9c95-0f384d11e5fc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:00.764723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00bd9c56-dd65-4248-9c95-0f384d11e5fc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:00.767235 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00bd9c56-dd65-4248-9c95-0f384d11e5fc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:00.793387 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-1efddfb8-66f1-4d11-9a8c-d1064d20aca1 req-210a34b7-dd8e-489c-a650-aa61ce7313f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7530cb60-25fa-4960-b9e9-00c48a4a7eff", "name": "network-vif-deleted", "tag": "c739f650-9402-41b8-aabb-ffdf7370fe7c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:00.807821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1efddfb8-66f1-4d11-9a8c-d1064d20aca1 req-210a34b7-dd8e-489c-a650-aa61ce7313f2 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:00.808282 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1efddfb8-66f1-4d11-9a8c-d1064d20aca1 req-210a34b7-dd8e-489c-a650-aa61ce7313f2 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:00.831133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-1efddfb8-66f1-4d11-9a8c-d1064d20aca1 req-210a34b7-dd8e-489c-a650-aa61ce7313f2 service nova] Creating event network-vif-deleted:c739f650-9402-41b8-aabb-ffdf7370fe7c for instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff on hv-cinder-81914 Jul 11 14:19:00.848567 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-1efddfb8-66f1-4d11-9a8c-d1064d20aca1 req-210a34b7-dd8e-489c-a650-aa61ce7313f2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157189 Jul 11 14:19:00.852957 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 292/570] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:19:00.987294 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-00bd9c56-dd65-4248-9c95-0f384d11e5fc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:00.995506 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-00bd9c56-dd65-4248-9c95-0f384d11e5fc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1518 microversion: 2.1 time: 0.253850 Jul 11 14:19:00.996428 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 279/571] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:00 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1518 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:01.023575 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d23201dc-b274-405b-a410-48bdcb958252 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:01.024518 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d23201dc-b274-405b-a410-48bdcb958252 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:01.032040 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d23201dc-b274-405b-a410-48bdcb958252 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:01.032538 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d23201dc-b274-405b-a410-48bdcb958252 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:01.034331 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d23201dc-b274-405b-a410-48bdcb958252 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:01.035690 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d23201dc-b274-405b-a410-48bdcb958252 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:01.059348 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:01.133959 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d23201dc-b274-405b-a410-48bdcb958252 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:01.145807 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d23201dc-b274-405b-a410-48bdcb958252 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:01.147367 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d23201dc-b274-405b-a410-48bdcb958252 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:01.148491 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d23201dc-b274-405b-a410-48bdcb958252 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1338 microversion: 2.20 time: 0.130604 Jul 11 14:19:01.149731 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 293/572] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:19:01 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1338 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:19:01.296777 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cdc9a5b5-8ad5-4f68-9086-a2ceb6d8dc9a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:01.297406 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cdc9a5b5-8ad5-4f68-9086-a2ceb6d8dc9a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:01.306259 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cdc9a5b5-8ad5-4f68-9086-a2ceb6d8dc9a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:01.306949 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cdc9a5b5-8ad5-4f68-9086-a2ceb6d8dc9a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:01.308154 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cdc9a5b5-8ad5-4f68-9086-a2ceb6d8dc9a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:01.308825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cdc9a5b5-8ad5-4f68-9086-a2ceb6d8dc9a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:01.316220 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:01.412125 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cdc9a5b5-8ad5-4f68-9086-a2ceb6d8dc9a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:01.425937 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cdc9a5b5-8ad5-4f68-9086-a2ceb6d8dc9a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 200 len: 1226 microversion: 2.1 time: 0.133588 Jul 11 14:19:01.427726 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 280/573] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:01 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 1226 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:02.014410 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-437e94a8-06b7-4422-a764-90b04f2ce06f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:02.015123 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-437e94a8-06b7-4422-a764-90b04f2ce06f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:02.021607 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-437e94a8-06b7-4422-a764-90b04f2ce06f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:02.022053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-437e94a8-06b7-4422-a764-90b04f2ce06f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:02.022872 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-437e94a8-06b7-4422-a764-90b04f2ce06f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:02.023300 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-437e94a8-06b7-4422-a764-90b04f2ce06f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:02.170406 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e7401b1e-d4b4-4866-a6ef-53e4d14f042b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:02.171749 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e7401b1e-d4b4-4866-a6ef-53e4d14f042b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:02.179700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7401b1e-d4b4-4866-a6ef-53e4d14f042b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:02.180602 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7401b1e-d4b4-4866-a6ef-53e4d14f042b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:02.181688 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7401b1e-d4b4-4866-a6ef-53e4d14f042b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:02.182287 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7401b1e-d4b4-4866-a6ef-53e4d14f042b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:02.333734 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e7401b1e-d4b4-4866-a6ef-53e4d14f042b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:02.334724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-437e94a8-06b7-4422-a764-90b04f2ce06f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:02.343451 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-437e94a8-06b7-4422-a764-90b04f2ce06f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1518 microversion: 2.1 time: 0.333740 Jul 11 14:19:02.344643 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 294/574] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:02 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1518 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:02.348473 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e7401b1e-d4b4-4866-a6ef-53e4d14f042b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:02.351207 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e7401b1e-d4b4-4866-a6ef-53e4d14f042b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:02.353106 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e7401b1e-d4b4-4866-a6ef-53e4d14f042b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1405 microversion: 2.20 time: 0.189597 Jul 11 14:19:02.353945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 281/575] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:19:02 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:19:02.443909 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7d1a5a71-d3b7-4a5c-af1b-62b60e6ebc50 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:02.444688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7d1a5a71-d3b7-4a5c-af1b-62b60e6ebc50 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:02.451717 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d1a5a71-d3b7-4a5c-af1b-62b60e6ebc50 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:02.452166 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d1a5a71-d3b7-4a5c-af1b-62b60e6ebc50 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:02.452942 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d1a5a71-d3b7-4a5c-af1b-62b60e6ebc50 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:02.453401 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d1a5a71-d3b7-4a5c-af1b-62b60e6ebc50 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:02.469786 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-7d1a5a71-d3b7-4a5c-af1b-62b60e6ebc50 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] HTTP exception thrown: Instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff could not be found. Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7d1a5a71-d3b7-4a5c-af1b-62b60e6ebc50 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Request method failure captured: Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff HTTP/1.1 Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDCWtrVPQbCUpon-pQ1xYhol8hBL6rk3TSkFxcaTbkECgG6FsCfZ2TYnTfbWTAw4B3A0QrIHkMoyrs8lZW3RyaBx-cBGYTGvlonbC5nfUHo8rg37cEdW1Xv9NfrPtPm332_ZshUaTRn39MebhPgRYP1k3wxtyWEO1b2zP9eJb5_Hd-0 Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 8da67a5ec9194e7bad1eb52c45a584bf Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestVolumeBootPattern-1971221977 Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:19:02.471499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:19:02.473067 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:19:02.473067 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestVolumeBootPattern-1971221977 Jul 11 14:19:02.473067 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 8da67a5ec9194e7bad1eb52c45a584bf Jul 11 14:19:02.473067 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestVolumeBootPattern-1971221977 Jul 11 14:19:02.473067 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-TestVolumeBootPattern-1971221977-project Jul 11 14:19:02.473067 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:19:02.473067 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:19:02.473067 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 5383a1d1bec34094a1889a86d87a88b5 Jul 11 14:19:02.473067 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestVolumeBootPattern-1971221977-project Jul 11 14:19:02.473067 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:19:02.473067 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff could not be found. Jul 11 14:19:02.473067 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': '7530cb60-25fa-4960-b9e9-00c48a4a7eff'} Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff could not be found. Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:19:02.473932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:19:02.475369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:19:02.475369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:19:02.475369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:19:02.475369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:19:02.475369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:19:02.475369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:19:02.475369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:19:02.475369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff could not be found. Jul 11 14:19:02.475369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:19:02.475369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:19:02.475369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:19:02.475369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:19:02.475369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:19:02.475369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:19:02.475369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:19:02.475369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:19:02.475369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff could not be found. Jul 11 14:19:02.475369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:19:02.477439 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7d1a5a71-d3b7-4a5c-af1b-62b60e6ebc50 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Returning 404 to user: Instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:19:02.477439 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7d1a5a71-d3b7-4a5c-af1b-62b60e6ebc50 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 404 len: 111 microversion: 2.1 time: 0.032877 Jul 11 14:19:02.478645 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 295/576] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:02 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:19:02.589656 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-50cf8dd7-f1a3-461e-bfe1-25ac708f784a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1783645883", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2127391203", "security_groups": [{"name": "tempest-secgroup-smoke-144034367"}], "block_device_mapping_v2": [{"uuid": "c0541b03-5b6c-4429-b923-dbe787f0bf38", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61698ae3-86b6-41a7-9062-ee7a458ad7a1"}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:02.865004 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-50cf8dd7-f1a3-461e-bfe1-25ac708f784a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] validate_networks() for [('61698ae3-86b6-41a7-9062-ee7a458ad7a1', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:19:02.889377 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-897b34cf-91ca-418a-8d5e-b5e1742a7df6 req-8f554093-01e8-4543-8e0b-933744dd1629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c32b876-b642-4e8f-b446-3381d1f545f0", "tag": "b94eb482-2115-40ae-8818-8ffac7eba877"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:02.903681 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-897b34cf-91ca-418a-8d5e-b5e1742a7df6 req-8f554093-01e8-4543-8e0b-933744dd1629 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:02.905216 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-897b34cf-91ca-418a-8d5e-b5e1742a7df6 req-8f554093-01e8-4543-8e0b-933744dd1629 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:02.937676 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-897b34cf-91ca-418a-8d5e-b5e1742a7df6 req-8f554093-01e8-4543-8e0b-933744dd1629 service nova] Creating event network-changed:b94eb482-2115-40ae-8818-8ffac7eba877 for instance 5c32b876-b642-4e8f-b446-3381d1f545f0 on hv-cinder-81914 Jul 11 14:19:02.945142 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-897b34cf-91ca-418a-8d5e-b5e1742a7df6 req-8f554093-01e8-4543-8e0b-933744dd1629 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059984 Jul 11 14:19:02.946469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 296/577] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:19:03.310089 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-50cf8dd7-f1a3-461e-bfe1-25ac708f784a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:19:03.310530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-50cf8dd7-f1a3-461e-bfe1-25ac708f784a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:19:03.310990 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-50cf8dd7-f1a3-461e-bfe1-25ac708f784a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:19:03.311423 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-50cf8dd7-f1a3-461e-bfe1-25ac708f784a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:19:03.311829 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-50cf8dd7-f1a3-461e-bfe1-25ac708f784a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:19:03.320411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50cf8dd7-f1a3-461e-bfe1-25ac708f784a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:03.320843 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50cf8dd7-f1a3-461e-bfe1-25ac708f784a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:03.321630 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50cf8dd7-f1a3-461e-bfe1-25ac708f784a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:03.322059 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50cf8dd7-f1a3-461e-bfe1-25ac708f784a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:03.338647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-50cf8dd7-f1a3-461e-bfe1-25ac708f784a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Getting quotas for project 8da67a5ec9194e7bad1eb52c45a584bf. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:19:03.342974 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-50cf8dd7-f1a3-461e-bfe1-25ac708f784a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Getting quotas for user 5383a1d1bec34094a1889a86d87a88b5 and project 8da67a5ec9194e7bad1eb52c45a584bf. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:19:03.361851 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ce97e1ba-d170-4a9c-8570-d9ef096b0c4a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:03.362580 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ce97e1ba-d170-4a9c-8570-d9ef096b0c4a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:03.368997 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce97e1ba-d170-4a9c-8570-d9ef096b0c4a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:03.369440 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce97e1ba-d170-4a9c-8570-d9ef096b0c4a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:03.370413 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce97e1ba-d170-4a9c-8570-d9ef096b0c4a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:03.370844 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce97e1ba-d170-4a9c-8570-d9ef096b0c4a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:03.405975 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-50cf8dd7-f1a3-461e-bfe1-25ac708f784a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:19:03.408201 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-50cf8dd7-f1a3-461e-bfe1-25ac708f784a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c0541b03-5b6c-4429-b923-dbe787f0bf38',volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:19:03.517815 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ce97e1ba-d170-4a9c-8570-d9ef096b0c4a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:03.525711 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ce97e1ba-d170-4a9c-8570-d9ef096b0c4a tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1518 microversion: 2.1 time: 0.168553 Jul 11 14:19:03.526316 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 297/578] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:03 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:03.530800 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e148523b-2a40-4961-a73a-203868c5a9ca tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:03.531407 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e148523b-2a40-4961-a73a-203868c5a9ca tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:03.537257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e148523b-2a40-4961-a73a-203868c5a9ca tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:03.537717 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e148523b-2a40-4961-a73a-203868c5a9ca tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:03.538504 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e148523b-2a40-4961-a73a-203868c5a9ca tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:03.538939 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e148523b-2a40-4961-a73a-203868c5a9ca tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:03.555611 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-50cf8dd7-f1a3-461e-bfe1-25ac708f784a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.970772 Jul 11 14:19:03.556470 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 282/579] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:19:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:19:03.567917 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0340b808-a3a8-4548-b633-fcb076c95804 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:03.568986 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0340b808-a3a8-4548-b633-fcb076c95804 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:03.631613 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0340b808-a3a8-4548-b633-fcb076c95804 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:03.639801 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0340b808-a3a8-4548-b633-fcb076c95804 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1095 microversion: 2.1 time: 0.076552 Jul 11 14:19:03.640701 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 283/580] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:03 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:03.696378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e148523b-2a40-4961-a73a-203868c5a9ca tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:03.706547 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e148523b-2a40-4961-a73a-203868c5a9ca tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:03.708081 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e148523b-2a40-4961-a73a-203868c5a9ca tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:03.709273 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e148523b-2a40-4961-a73a-203868c5a9ca tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1405 microversion: 2.20 time: 0.181974 Jul 11 14:19:03.709785 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 298/581] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:19:03 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:19:04.543941 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a415666a-d8d1-46ba-a3a3-26ffcc8aace6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:04.544596 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a415666a-d8d1-46ba-a3a3-26ffcc8aace6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:04.552605 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a415666a-d8d1-46ba-a3a3-26ffcc8aace6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:04.553198 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a415666a-d8d1-46ba-a3a3-26ffcc8aace6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:04.554137 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a415666a-d8d1-46ba-a3a3-26ffcc8aace6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:04.554731 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a415666a-d8d1-46ba-a3a3-26ffcc8aace6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:04.657025 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-038ac48c-cefc-4011-a4a4-172e738deeeb tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:04.657652 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-038ac48c-cefc-4011-a4a4-172e738deeeb tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:04.664626 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-038ac48c-cefc-4011-a4a4-172e738deeeb tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:04.665083 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-038ac48c-cefc-4011-a4a4-172e738deeeb tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:04.665870 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-038ac48c-cefc-4011-a4a4-172e738deeeb tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:04.666395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-038ac48c-cefc-4011-a4a4-172e738deeeb tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:04.695156 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a415666a-d8d1-46ba-a3a3-26ffcc8aace6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:04.704087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a415666a-d8d1-46ba-a3a3-26ffcc8aace6 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1518 microversion: 2.1 time: 0.164168 Jul 11 14:19:04.704677 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 284/582] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:04 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:04.727849 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b97e128f-f1c6-418d-8f5b-d172599d7c92 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:04.728405 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b97e128f-f1c6-418d-8f5b-d172599d7c92 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:04.732156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-038ac48c-cefc-4011-a4a4-172e738deeeb tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:04.734779 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b97e128f-f1c6-418d-8f5b-d172599d7c92 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:04.735228 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b97e128f-f1c6-418d-8f5b-d172599d7c92 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:04.736005 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b97e128f-f1c6-418d-8f5b-d172599d7c92 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:04.736434 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b97e128f-f1c6-418d-8f5b-d172599d7c92 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:04.739720 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-038ac48c-cefc-4011-a4a4-172e738deeeb tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1145 microversion: 2.1 time: 0.087214 Jul 11 14:19:04.740293 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 299/583] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:04 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:04.868113 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b97e128f-f1c6-418d-8f5b-d172599d7c92 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:04.877257 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b97e128f-f1c6-418d-8f5b-d172599d7c92 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:04.878802 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b97e128f-f1c6-418d-8f5b-d172599d7c92 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:04.879909 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b97e128f-f1c6-418d-8f5b-d172599d7c92 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1405 microversion: 2.20 time: 0.156177 Jul 11 14:19:04.880466 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 285/584] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:19:04 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:19:05.721851 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-96709424-fea6-428e-a7d1-d0bdc806ccbc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:05.722528 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-96709424-fea6-428e-a7d1-d0bdc806ccbc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:05.729148 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96709424-fea6-428e-a7d1-d0bdc806ccbc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:05.729600 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96709424-fea6-428e-a7d1-d0bdc806ccbc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:05.730401 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96709424-fea6-428e-a7d1-d0bdc806ccbc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:05.730839 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96709424-fea6-428e-a7d1-d0bdc806ccbc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:05.756642 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bd8734b5-00bd-4515-9b3f-6ef0f7e950fe tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:05.757295 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bd8734b5-00bd-4515-9b3f-6ef0f7e950fe tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:05.764309 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd8734b5-00bd-4515-9b3f-6ef0f7e950fe tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:05.764762 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd8734b5-00bd-4515-9b3f-6ef0f7e950fe tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:05.765552 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd8734b5-00bd-4515-9b3f-6ef0f7e950fe tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:05.765991 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd8734b5-00bd-4515-9b3f-6ef0f7e950fe tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:05.836312 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bd8734b5-00bd-4515-9b3f-6ef0f7e950fe tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:05.846257 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bd8734b5-00bd-4515-9b3f-6ef0f7e950fe tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1145 microversion: 2.1 time: 0.093354 Jul 11 14:19:05.847310 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 286/585] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:05 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:05.902189 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-827a88ff-3d31-4b29-b434-14a3e6764494 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:05.902519 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-827a88ff-3d31-4b29-b434-14a3e6764494 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:05.917386 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-827a88ff-3d31-4b29-b434-14a3e6764494 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:05.918256 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-827a88ff-3d31-4b29-b434-14a3e6764494 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:05.919488 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-827a88ff-3d31-4b29-b434-14a3e6764494 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:05.919928 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-827a88ff-3d31-4b29-b434-14a3e6764494 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:05.938097 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-96709424-fea6-428e-a7d1-d0bdc806ccbc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:05.957852 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-96709424-fea6-428e-a7d1-d0bdc806ccbc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1518 microversion: 2.1 time: 0.239856 Jul 11 14:19:05.958478 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 300/586] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:05 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1518 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:06.067920 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-827a88ff-3d31-4b29-b434-14a3e6764494 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:06.077010 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-827a88ff-3d31-4b29-b434-14a3e6764494 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:06.078575 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-827a88ff-3d31-4b29-b434-14a3e6764494 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:06.079694 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-827a88ff-3d31-4b29-b434-14a3e6764494 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1405 microversion: 2.20 time: 0.183924 Jul 11 14:19:06.080256 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 287/587] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:19:05 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:19:06.863840 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-16bf2c8c-a1c4-4ff7-907f-821291d493c1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:06.864433 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-16bf2c8c-a1c4-4ff7-907f-821291d493c1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:06.872877 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16bf2c8c-a1c4-4ff7-907f-821291d493c1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:06.873276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16bf2c8c-a1c4-4ff7-907f-821291d493c1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:06.874052 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16bf2c8c-a1c4-4ff7-907f-821291d493c1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:06.874527 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16bf2c8c-a1c4-4ff7-907f-821291d493c1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:06.952713 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-16bf2c8c-a1c4-4ff7-907f-821291d493c1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:06.962831 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-16bf2c8c-a1c4-4ff7-907f-821291d493c1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1211 microversion: 2.1 time: 0.102741 Jul 11 14:19:06.963518 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 301/588] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:06 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:06.976915 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8559084f-3673-41a7-a9b7-40cf5384ad6c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:06.977563 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8559084f-3673-41a7-a9b7-40cf5384ad6c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:06.983740 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8559084f-3673-41a7-a9b7-40cf5384ad6c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:06.984187 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8559084f-3673-41a7-a9b7-40cf5384ad6c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:06.984950 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8559084f-3673-41a7-a9b7-40cf5384ad6c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:06.985388 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8559084f-3673-41a7-a9b7-40cf5384ad6c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:07.098639 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3bd31302-a39b-4e30-93ea-c583ae51373d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:07.099263 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3bd31302-a39b-4e30-93ea-c583ae51373d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:07.105754 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bd31302-a39b-4e30-93ea-c583ae51373d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:07.106383 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bd31302-a39b-4e30-93ea-c583ae51373d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:07.107636 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bd31302-a39b-4e30-93ea-c583ae51373d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:07.109023 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bd31302-a39b-4e30-93ea-c583ae51373d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:07.140561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8559084f-3673-41a7-a9b7-40cf5384ad6c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:07.148177 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8559084f-3673-41a7-a9b7-40cf5384ad6c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1574 microversion: 2.1 time: 0.175760 Jul 11 14:19:07.148754 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 288/589] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:06 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:07.248105 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3bd31302-a39b-4e30-93ea-c583ae51373d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:07.256569 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3bd31302-a39b-4e30-93ea-c583ae51373d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:07.258096 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3bd31302-a39b-4e30-93ea-c583ae51373d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:07.259251 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3bd31302-a39b-4e30-93ea-c583ae51373d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1405 microversion: 2.20 time: 0.164519 Jul 11 14:19:07.259826 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 302/590] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:19:07 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:19:07.981072 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-95dab101-984f-4624-a4b4-b6abbc17b08a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:07.982285 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-95dab101-984f-4624-a4b4-b6abbc17b08a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:07.988873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95dab101-984f-4624-a4b4-b6abbc17b08a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:07.989323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95dab101-984f-4624-a4b4-b6abbc17b08a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:07.990092 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95dab101-984f-4624-a4b4-b6abbc17b08a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:07.990571 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95dab101-984f-4624-a4b4-b6abbc17b08a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:08.053403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-95dab101-984f-4624-a4b4-b6abbc17b08a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:08.060889 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-95dab101-984f-4624-a4b4-b6abbc17b08a tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1211 microversion: 2.1 time: 0.083839 Jul 11 14:19:08.061674 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 289/591] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:07 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:08.166907 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b1664676-fc55-4ec9-a037-9ed6909b9e21 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:08.167521 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b1664676-fc55-4ec9-a037-9ed6909b9e21 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:08.174175 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1664676-fc55-4ec9-a037-9ed6909b9e21 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:08.174634 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1664676-fc55-4ec9-a037-9ed6909b9e21 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:08.175406 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1664676-fc55-4ec9-a037-9ed6909b9e21 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:08.175842 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1664676-fc55-4ec9-a037-9ed6909b9e21 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:08.276681 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-412fb5a3-8d15-40df-8c2e-f3c1a462700c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:08.277303 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-412fb5a3-8d15-40df-8c2e-f3c1a462700c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:08.283451 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-412fb5a3-8d15-40df-8c2e-f3c1a462700c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:08.284135 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-412fb5a3-8d15-40df-8c2e-f3c1a462700c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:08.284913 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-412fb5a3-8d15-40df-8c2e-f3c1a462700c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:08.285349 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-412fb5a3-8d15-40df-8c2e-f3c1a462700c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:08.315115 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b1664676-fc55-4ec9-a037-9ed6909b9e21 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:08.323002 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b1664676-fc55-4ec9-a037-9ed6909b9e21 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1574 microversion: 2.1 time: 0.159852 Jul 11 14:19:08.323642 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 303/592] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:08 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:08.415763 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-412fb5a3-8d15-40df-8c2e-f3c1a462700c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:08.425424 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-412fb5a3-8d15-40df-8c2e-f3c1a462700c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:08.427943 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-412fb5a3-8d15-40df-8c2e-f3c1a462700c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:08.429652 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-412fb5a3-8d15-40df-8c2e-f3c1a462700c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1405 microversion: 2.20 time: 0.156638 Jul 11 14:19:08.430620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 290/593] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:19:08 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:19:09.077355 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c191bbe6-d03c-4a51-b954-886cb3b26d62 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:09.077969 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c191bbe6-d03c-4a51-b954-886cb3b26d62 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:09.079958 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:09.085452 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c191bbe6-d03c-4a51-b954-886cb3b26d62 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:09.085900 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c191bbe6-d03c-4a51-b954-886cb3b26d62 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:09.086704 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c191bbe6-d03c-4a51-b954-886cb3b26d62 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:09.087139 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c191bbe6-d03c-4a51-b954-886cb3b26d62 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:09.150952 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c191bbe6-d03c-4a51-b954-886cb3b26d62 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:09.159220 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c191bbe6-d03c-4a51-b954-886cb3b26d62 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1211 microversion: 2.1 time: 0.086277 Jul 11 14:19:09.159804 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 304/594] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:09 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:09.342742 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0ba5fb25-118c-4af3-944b-bd926a2968bb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:09.343356 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0ba5fb25-118c-4af3-944b-bd926a2968bb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:09.349979 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0ba5fb25-118c-4af3-944b-bd926a2968bb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:09.350457 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0ba5fb25-118c-4af3-944b-bd926a2968bb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:09.351225 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0ba5fb25-118c-4af3-944b-bd926a2968bb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:09.351663 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0ba5fb25-118c-4af3-944b-bd926a2968bb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:09.453295 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-728bb4d6-a051-477a-9e42-e3249428bfbe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:09.454010 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-728bb4d6-a051-477a-9e42-e3249428bfbe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:09.460726 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-728bb4d6-a051-477a-9e42-e3249428bfbe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:09.461172 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-728bb4d6-a051-477a-9e42-e3249428bfbe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:09.461944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-728bb4d6-a051-477a-9e42-e3249428bfbe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:09.462407 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-728bb4d6-a051-477a-9e42-e3249428bfbe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:09.493788 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0ba5fb25-118c-4af3-944b-bd926a2968bb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:09.502046 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0ba5fb25-118c-4af3-944b-bd926a2968bb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1574 microversion: 2.1 time: 0.163779 Jul 11 14:19:09.502768 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 291/595] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:09 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:09.598562 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-728bb4d6-a051-477a-9e42-e3249428bfbe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:09.607190 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-728bb4d6-a051-477a-9e42-e3249428bfbe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:09.608723 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-728bb4d6-a051-477a-9e42-e3249428bfbe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:09.609839 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-728bb4d6-a051-477a-9e42-e3249428bfbe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1405 microversion: 2.20 time: 0.161002 Jul 11 14:19:09.610445 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 305/596] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:19:09 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:19:10.177114 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e8162f1a-6442-4289-918b-dcf7d1db8708 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:10.177732 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e8162f1a-6442-4289-918b-dcf7d1db8708 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:10.183657 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e8162f1a-6442-4289-918b-dcf7d1db8708 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:10.184086 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e8162f1a-6442-4289-918b-dcf7d1db8708 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:10.185434 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e8162f1a-6442-4289-918b-dcf7d1db8708 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:10.185865 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e8162f1a-6442-4289-918b-dcf7d1db8708 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:10.247355 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e8162f1a-6442-4289-918b-dcf7d1db8708 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:10.255503 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e8162f1a-6442-4289-918b-dcf7d1db8708 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1211 microversion: 2.1 time: 0.082523 Jul 11 14:19:10.256074 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 292/597] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:10 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:10.519295 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b812bd6e-aec5-4ca9-8def-95ba5cb29975 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:10.519849 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b812bd6e-aec5-4ca9-8def-95ba5cb29975 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:10.526455 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b812bd6e-aec5-4ca9-8def-95ba5cb29975 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:10.526904 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b812bd6e-aec5-4ca9-8def-95ba5cb29975 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:10.527661 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b812bd6e-aec5-4ca9-8def-95ba5cb29975 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:10.528094 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b812bd6e-aec5-4ca9-8def-95ba5cb29975 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:10.629528 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-83e9f556-ef26-44da-8138-3d7c98131bec tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:10.630290 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-83e9f556-ef26-44da-8138-3d7c98131bec tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:10.638225 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83e9f556-ef26-44da-8138-3d7c98131bec tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:10.638754 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83e9f556-ef26-44da-8138-3d7c98131bec tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:10.639638 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83e9f556-ef26-44da-8138-3d7c98131bec tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:10.640078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83e9f556-ef26-44da-8138-3d7c98131bec tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:10.666866 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b812bd6e-aec5-4ca9-8def-95ba5cb29975 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:10.675411 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b812bd6e-aec5-4ca9-8def-95ba5cb29975 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1574 microversion: 2.1 time: 0.159982 Jul 11 14:19:10.676004 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 306/598] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:10 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:11.062493 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-83e9f556-ef26-44da-8138-3d7c98131bec tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:11.072257 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-83e9f556-ef26-44da-8138-3d7c98131bec tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:11.073896 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-83e9f556-ef26-44da-8138-3d7c98131bec tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:11.075251 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-83e9f556-ef26-44da-8138-3d7c98131bec tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1405 microversion: 2.20 time: 0.450312 Jul 11 14:19:11.076075 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 293/599] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:19:10 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:19:11.276748 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-268f0588-3636-4218-a453-ae00abebaaa1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:11.277677 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-268f0588-3636-4218-a453-ae00abebaaa1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:11.290439 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-268f0588-3636-4218-a453-ae00abebaaa1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:11.291168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-268f0588-3636-4218-a453-ae00abebaaa1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:11.292666 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-268f0588-3636-4218-a453-ae00abebaaa1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:11.293316 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-268f0588-3636-4218-a453-ae00abebaaa1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:11.420427 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-268f0588-3636-4218-a453-ae00abebaaa1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:11.432745 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-268f0588-3636-4218-a453-ae00abebaaa1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1211 microversion: 2.1 time: 0.162844 Jul 11 14:19:11.442350 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 307/600] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:11 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1211 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:11.693000 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2b4dd066-52a4-4045-aa23-7415f6eac8cb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:11.693660 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2b4dd066-52a4-4045-aa23-7415f6eac8cb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:11.701384 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2b4dd066-52a4-4045-aa23-7415f6eac8cb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:11.701843 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2b4dd066-52a4-4045-aa23-7415f6eac8cb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:11.702672 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2b4dd066-52a4-4045-aa23-7415f6eac8cb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:11.703117 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2b4dd066-52a4-4045-aa23-7415f6eac8cb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:11.854517 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2b4dd066-52a4-4045-aa23-7415f6eac8cb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:11.862692 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2b4dd066-52a4-4045-aa23-7415f6eac8cb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1574 microversion: 2.1 time: 0.173614 Jul 11 14:19:11.863281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 294/601] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:11 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:12.094169 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ecd6b412-2575-4674-aa0a-4c436677b3a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:12.094783 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ecd6b412-2575-4674-aa0a-4c436677b3a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:12.101967 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecd6b412-2575-4674-aa0a-4c436677b3a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:12.103233 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecd6b412-2575-4674-aa0a-4c436677b3a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:12.104372 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecd6b412-2575-4674-aa0a-4c436677b3a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:12.104822 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecd6b412-2575-4674-aa0a-4c436677b3a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:12.254572 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ecd6b412-2575-4674-aa0a-4c436677b3a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:12.264250 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ecd6b412-2575-4674-aa0a-4c436677b3a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:12.265860 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ecd6b412-2575-4674-aa0a-4c436677b3a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:12.267026 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ecd6b412-2575-4674-aa0a-4c436677b3a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1405 microversion: 2.20 time: 0.176860 Jul 11 14:19:12.267608 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 308/602] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:19:12 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:19:12.454414 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9cd495f7-52ca-4451-a666-c6e9dc77b6ae tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:12.456166 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9cd495f7-52ca-4451-a666-c6e9dc77b6ae tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:12.465593 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9cd495f7-52ca-4451-a666-c6e9dc77b6ae tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:12.466851 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9cd495f7-52ca-4451-a666-c6e9dc77b6ae tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:12.468528 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9cd495f7-52ca-4451-a666-c6e9dc77b6ae tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:12.469252 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9cd495f7-52ca-4451-a666-c6e9dc77b6ae tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:12.696385 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9cd495f7-52ca-4451-a666-c6e9dc77b6ae tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:12.708518 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9cd495f7-52ca-4451-a666-c6e9dc77b6ae tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1266 microversion: 2.1 time: 0.261190 Jul 11 14:19:12.718468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 295/603] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:12 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:12.855419 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-12f15964-37de-40c0-b3b3-05871b5ccf5f req-a747a118-482a-41e1-a307-0fcdf2c9f6c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be66bb60-a0c4-4db8-8eca-61debf0d1604", "tag": "de27be74-eeae-4fd8-9e66-9d465aca8acc"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:12.866100 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-12f15964-37de-40c0-b3b3-05871b5ccf5f req-a747a118-482a-41e1-a307-0fcdf2c9f6c9 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:12.866738 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-12f15964-37de-40c0-b3b3-05871b5ccf5f req-a747a118-482a-41e1-a307-0fcdf2c9f6c9 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:12.880552 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-12f15964-37de-40c0-b3b3-05871b5ccf5f req-a747a118-482a-41e1-a307-0fcdf2c9f6c9 service nova] Creating event network-changed:de27be74-eeae-4fd8-9e66-9d465aca8acc for instance be66bb60-a0c4-4db8-8eca-61debf0d1604 on hv-cinder-81914 Jul 11 14:19:12.881269 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-910d0e67-6117-4133-951e-fcc02d7488af tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:12.882010 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-910d0e67-6117-4133-951e-fcc02d7488af tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:12.885438 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-12f15964-37de-40c0-b3b3-05871b5ccf5f req-a747a118-482a-41e1-a307-0fcdf2c9f6c9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103178 Jul 11 14:19:12.886597 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 309/604] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:19:12.889010 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-910d0e67-6117-4133-951e-fcc02d7488af tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:12.889463 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-910d0e67-6117-4133-951e-fcc02d7488af tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:12.890278 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-910d0e67-6117-4133-951e-fcc02d7488af tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:12.890718 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-910d0e67-6117-4133-951e-fcc02d7488af tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:13.107629 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-910d0e67-6117-4133-951e-fcc02d7488af tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:13.115576 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-910d0e67-6117-4133-951e-fcc02d7488af tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1574 microversion: 2.1 time: 0.238593 Jul 11 14:19:13.116158 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 296/605] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:12 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1574 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:13.285807 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bfcd5f7f-9abf-46d6-bcf0-151aee08f2fa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:13.286542 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bfcd5f7f-9abf-46d6-bcf0-151aee08f2fa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:13.300879 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bfcd5f7f-9abf-46d6-bcf0-151aee08f2fa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:13.301381 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bfcd5f7f-9abf-46d6-bcf0-151aee08f2fa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:13.303329 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bfcd5f7f-9abf-46d6-bcf0-151aee08f2fa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:13.303771 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bfcd5f7f-9abf-46d6-bcf0-151aee08f2fa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:13.438963 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bfcd5f7f-9abf-46d6-bcf0-151aee08f2fa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:13.447138 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bfcd5f7f-9abf-46d6-bcf0-151aee08f2fa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:13.448664 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bfcd5f7f-9abf-46d6-bcf0-151aee08f2fa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:13.450319 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bfcd5f7f-9abf-46d6-bcf0-151aee08f2fa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1405 microversion: 2.20 time: 0.168658 Jul 11 14:19:13.451256 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 310/606] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:19:13 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:19:13.727877 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8bcf70c3-89e0-4d97-8717-9477233fc2e8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:13.728786 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8bcf70c3-89e0-4d97-8717-9477233fc2e8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:13.731425 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=4 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:13.732341 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=18 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:13.739390 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8bcf70c3-89e0-4d97-8717-9477233fc2e8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:13.740088 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8bcf70c3-89e0-4d97-8717-9477233fc2e8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:13.740873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8bcf70c3-89e0-4d97-8717-9477233fc2e8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:13.741317 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8bcf70c3-89e0-4d97-8717-9477233fc2e8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:13.966956 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8bcf70c3-89e0-4d97-8717-9477233fc2e8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:13.974764 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8bcf70c3-89e0-4d97-8717-9477233fc2e8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1266 microversion: 2.1 time: 0.252033 Jul 11 14:19:13.975341 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 297/607] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:13 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:14.133006 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f460906a-c065-4783-bf62-fd196f7b86a5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:14.133729 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f460906a-c065-4783-bf62-fd196f7b86a5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:14.141663 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f460906a-c065-4783-bf62-fd196f7b86a5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:14.142118 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f460906a-c065-4783-bf62-fd196f7b86a5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:14.142932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f460906a-c065-4783-bf62-fd196f7b86a5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:14.143370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f460906a-c065-4783-bf62-fd196f7b86a5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:14.300921 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f460906a-c065-4783-bf62-fd196f7b86a5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:14.309058 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f460906a-c065-4783-bf62-fd196f7b86a5 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1574 microversion: 2.1 time: 0.179940 Jul 11 14:19:14.310276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 311/608] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:14 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1574 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:14.468500 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-58e17cf5-c732-4561-9d5a-ef5048828920 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:14.469028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-58e17cf5-c732-4561-9d5a-ef5048828920 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:14.475284 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58e17cf5-c732-4561-9d5a-ef5048828920 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:14.475740 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58e17cf5-c732-4561-9d5a-ef5048828920 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:14.476517 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58e17cf5-c732-4561-9d5a-ef5048828920 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:14.476954 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58e17cf5-c732-4561-9d5a-ef5048828920 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:14.495836 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:14.612372 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-24435e07-428a-4648-a7ca-f40e9750afe0 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:14.612874 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-24435e07-428a-4648-a7ca-f40e9750afe0 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:14.619482 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24435e07-428a-4648-a7ca-f40e9750afe0 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:14.620281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24435e07-428a-4648-a7ca-f40e9750afe0 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:14.621126 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24435e07-428a-4648-a7ca-f40e9750afe0 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:14.621566 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24435e07-428a-4648-a7ca-f40e9750afe0 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:14.627130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:14.627346 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-58e17cf5-c732-4561-9d5a-ef5048828920 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:14.635103 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-58e17cf5-c732-4561-9d5a-ef5048828920 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:14.636625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-58e17cf5-c732-4561-9d5a-ef5048828920 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:14.638007 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-58e17cf5-c732-4561-9d5a-ef5048828920 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1405 microversion: 2.20 time: 0.173471 Jul 11 14:19:14.638762 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 298/609] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:19:14 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:19:14.702724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-24435e07-428a-4648-a7ca-f40e9750afe0 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lazy-loading 'services' on Instance uuid 947f4a70-daac-4e48-9891-235b34895d99 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:19:14.774787 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-24435e07-428a-4648-a7ca-f40e9750afe0 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "DELETE /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99/os-volume_attachments/f87ae22c-5cc1-4ae1-93e1-b0ea14911578" status: 202 len: 0 microversion: 2.1 time: 0.166108 Jul 11 14:19:14.775390 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 312/610] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 11 14:19:14 2022] DELETE /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99/os-volume_attachments/f87ae22c-5cc1-4ae1-93e1-b0ea14911578 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:19:14.991804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8f5d46bb-86e1-4d1a-a46f-edfe92ec89aa tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:14.992356 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8f5d46bb-86e1-4d1a-a46f-edfe92ec89aa tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:15.000026 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f5d46bb-86e1-4d1a-a46f-edfe92ec89aa tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:15.000486 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f5d46bb-86e1-4d1a-a46f-edfe92ec89aa tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:15.001252 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f5d46bb-86e1-4d1a-a46f-edfe92ec89aa tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:15.001690 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f5d46bb-86e1-4d1a-a46f-edfe92ec89aa tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:15.138547 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8f5d46bb-86e1-4d1a-a46f-edfe92ec89aa tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:15.145999 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8f5d46bb-86e1-4d1a-a46f-edfe92ec89aa tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1266 microversion: 2.1 time: 0.158202 Jul 11 14:19:15.146598 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 299/611] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:14 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:15.321566 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-1094776a-9d54-487a-86bc-2ae26a482180 req-d8d6204c-1a2e-414f-8f13-b8aa1faa4621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c32b876-b642-4e8f-b446-3381d1f545f0", "name": "network-vif-plugged", "status": "completed", "tag": "b94eb482-2115-40ae-8818-8ffac7eba877"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:15.329194 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-99a88e41-b338-4e4a-8ba3-dec348e13c4f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:15.330120 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-99a88e41-b338-4e4a-8ba3-dec348e13c4f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:15.337024 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99a88e41-b338-4e4a-8ba3-dec348e13c4f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:15.337239 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1094776a-9d54-487a-86bc-2ae26a482180 req-d8d6204c-1a2e-414f-8f13-b8aa1faa4621 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:15.337672 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1094776a-9d54-487a-86bc-2ae26a482180 req-d8d6204c-1a2e-414f-8f13-b8aa1faa4621 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:15.338115 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99a88e41-b338-4e4a-8ba3-dec348e13c4f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:15.339515 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99a88e41-b338-4e4a-8ba3-dec348e13c4f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:15.340180 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99a88e41-b338-4e4a-8ba3-dec348e13c4f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:15.351589 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-1094776a-9d54-487a-86bc-2ae26a482180 req-d8d6204c-1a2e-414f-8f13-b8aa1faa4621 service nova] Creating event network-vif-plugged:b94eb482-2115-40ae-8818-8ffac7eba877 for instance 5c32b876-b642-4e8f-b446-3381d1f545f0 on hv-cinder-81914 Jul 11 14:19:15.356879 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-1094776a-9d54-487a-86bc-2ae26a482180 req-d8d6204c-1a2e-414f-8f13-b8aa1faa4621 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040241 Jul 11 14:19:15.358046 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 313/612] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:19:15.487015 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-99a88e41-b338-4e4a-8ba3-dec348e13c4f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:15.494657 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-99a88e41-b338-4e4a-8ba3-dec348e13c4f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1574 microversion: 2.1 time: 0.171330 Jul 11 14:19:15.495249 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 300/613] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:15 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:15.659602 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2cb4461f-fe48-457f-8fe9-3d27245d2ec0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:15.661072 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2cb4461f-fe48-457f-8fe9-3d27245d2ec0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:15.676977 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2cb4461f-fe48-457f-8fe9-3d27245d2ec0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:15.678485 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2cb4461f-fe48-457f-8fe9-3d27245d2ec0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:15.682702 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2cb4461f-fe48-457f-8fe9-3d27245d2ec0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:15.683255 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2cb4461f-fe48-457f-8fe9-3d27245d2ec0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:15.830813 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2cb4461f-fe48-457f-8fe9-3d27245d2ec0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:15.843637 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2cb4461f-fe48-457f-8fe9-3d27245d2ec0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:15.845271 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2cb4461f-fe48-457f-8fe9-3d27245d2ec0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:15.846443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2cb4461f-fe48-457f-8fe9-3d27245d2ec0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1405 microversion: 2.20 time: 0.193402 Jul 11 14:19:15.857410 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 314/614] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:19:15 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1405 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:19:15.899595 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1de1dd2a-e07b-45f6-85a5-fab8b1d21b71 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:15.900098 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1de1dd2a-e07b-45f6-85a5-fab8b1d21b71 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:15.907690 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1de1dd2a-e07b-45f6-85a5-fab8b1d21b71 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:15.908154 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1de1dd2a-e07b-45f6-85a5-fab8b1d21b71 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:15.908926 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1de1dd2a-e07b-45f6-85a5-fab8b1d21b71 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:15.909359 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1de1dd2a-e07b-45f6-85a5-fab8b1d21b71 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:15.937585 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1de1dd2a-e07b-45f6-85a5-fab8b1d21b71 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:19:16.016238 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1de1dd2a-e07b-45f6-85a5-fab8b1d21b71 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "DELETE /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 204 len: 0 microversion: 2.1 time: 0.120241 Jul 11 14:19:16.017220 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 301/615] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:19:15 2022] DELETE /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:19:16.025397 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3426ea07-703c-4803-ae47-39c631194f57 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:16.026026 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3426ea07-703c-4803-ae47-39c631194f57 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:16.035172 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3426ea07-703c-4803-ae47-39c631194f57 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:16.035635 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3426ea07-703c-4803-ae47-39c631194f57 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:16.036428 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3426ea07-703c-4803-ae47-39c631194f57 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:16.036865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3426ea07-703c-4803-ae47-39c631194f57 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:16.164787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ee8c630f-940c-4788-9c2c-215c8039b1c8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:16.165489 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ee8c630f-940c-4788-9c2c-215c8039b1c8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:16.171656 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee8c630f-940c-4788-9c2c-215c8039b1c8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:16.172103 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee8c630f-940c-4788-9c2c-215c8039b1c8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:16.172878 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee8c630f-940c-4788-9c2c-215c8039b1c8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:16.173310 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee8c630f-940c-4788-9c2c-215c8039b1c8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:16.180902 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3426ea07-703c-4803-ae47-39c631194f57 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:16.189047 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3426ea07-703c-4803-ae47-39c631194f57 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 200 len: 1513 microversion: 2.1 time: 0.167723 Jul 11 14:19:16.189640 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 315/616] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:16 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:16.313682 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ee8c630f-940c-4788-9c2c-215c8039b1c8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:16.321160 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ee8c630f-940c-4788-9c2c-215c8039b1c8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1266 microversion: 2.1 time: 0.161155 Jul 11 14:19:16.321725 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 302/617] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:16 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:16.512119 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5a246822-a4f6-40f5-bf05-3f824926e3cc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:16.512773 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5a246822-a4f6-40f5-bf05-3f824926e3cc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:16.519244 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a246822-a4f6-40f5-bf05-3f824926e3cc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:16.519688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a246822-a4f6-40f5-bf05-3f824926e3cc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:16.520452 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a246822-a4f6-40f5-bf05-3f824926e3cc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:16.520883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a246822-a4f6-40f5-bf05-3f824926e3cc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:16.663913 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5a246822-a4f6-40f5-bf05-3f824926e3cc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:16.672395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5a246822-a4f6-40f5-bf05-3f824926e3cc tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1574 microversion: 2.1 time: 0.164206 Jul 11 14:19:16.672968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 316/618] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:16 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:16.865431 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-119dfc93-11bc-46ea-84cd-db963825e6b8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:16.865943 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-119dfc93-11bc-46ea-84cd-db963825e6b8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:16.872299 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-119dfc93-11bc-46ea-84cd-db963825e6b8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:16.872737 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-119dfc93-11bc-46ea-84cd-db963825e6b8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:16.873491 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-119dfc93-11bc-46ea-84cd-db963825e6b8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:16.873925 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-119dfc93-11bc-46ea-84cd-db963825e6b8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:17.005397 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-119dfc93-11bc-46ea-84cd-db963825e6b8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:17.013538 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-119dfc93-11bc-46ea-84cd-db963825e6b8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:17.015087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-119dfc93-11bc-46ea-84cd-db963825e6b8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:17.016198 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-119dfc93-11bc-46ea-84cd-db963825e6b8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1405 microversion: 2.20 time: 0.154750 Jul 11 14:19:17.016759 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 303/619] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:19:16 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:19:17.206959 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7c07aaea-c4f4-4d96-9a4f-8400d0184c3e tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:17.207562 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7c07aaea-c4f4-4d96-9a4f-8400d0184c3e tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:17.217879 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c07aaea-c4f4-4d96-9a4f-8400d0184c3e tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:17.218357 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c07aaea-c4f4-4d96-9a4f-8400d0184c3e tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:17.219132 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c07aaea-c4f4-4d96-9a4f-8400d0184c3e tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:17.219559 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c07aaea-c4f4-4d96-9a4f-8400d0184c3e tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:17.338505 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-655af141-7a5b-4093-8959-4386c4cf7d61 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:17.339237 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-655af141-7a5b-4093-8959-4386c4cf7d61 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:17.346340 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-655af141-7a5b-4093-8959-4386c4cf7d61 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:17.346641 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-655af141-7a5b-4093-8959-4386c4cf7d61 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:17.347402 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-655af141-7a5b-4093-8959-4386c4cf7d61 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:17.347836 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-655af141-7a5b-4093-8959-4386c4cf7d61 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:17.348796 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7c07aaea-c4f4-4d96-9a4f-8400d0184c3e tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:17.356643 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7c07aaea-c4f4-4d96-9a4f-8400d0184c3e tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 200 len: 1513 microversion: 2.1 time: 0.153307 Jul 11 14:19:17.357277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 317/620] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:17 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:17.478016 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-655af141-7a5b-4093-8959-4386c4cf7d61 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:17.485772 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-655af141-7a5b-4093-8959-4386c4cf7d61 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1266 microversion: 2.1 time: 0.151117 Jul 11 14:19:17.486382 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 304/621] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:17 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:17.689497 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-632a8493-ee4a-4246-b7f0-b9f7c1191308 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:17.690113 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-632a8493-ee4a-4246-b7f0-b9f7c1191308 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:17.696992 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-632a8493-ee4a-4246-b7f0-b9f7c1191308 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:17.697441 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-632a8493-ee4a-4246-b7f0-b9f7c1191308 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:17.698238 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-632a8493-ee4a-4246-b7f0-b9f7c1191308 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:17.698674 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-632a8493-ee4a-4246-b7f0-b9f7c1191308 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:17.829041 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-632a8493-ee4a-4246-b7f0-b9f7c1191308 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:17.843561 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-632a8493-ee4a-4246-b7f0-b9f7c1191308 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1574 microversion: 2.1 time: 0.157876 Jul 11 14:19:17.844174 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 318/622] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:17 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:18.034141 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1149e71f-a841-4b16-9ff3-367606ba5b33 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:18.034728 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1149e71f-a841-4b16-9ff3-367606ba5b33 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:18.041136 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1149e71f-a841-4b16-9ff3-367606ba5b33 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:18.041574 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1149e71f-a841-4b16-9ff3-367606ba5b33 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:18.042358 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1149e71f-a841-4b16-9ff3-367606ba5b33 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:18.042790 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1149e71f-a841-4b16-9ff3-367606ba5b33 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:18.174967 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1149e71f-a841-4b16-9ff3-367606ba5b33 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:18.182838 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1149e71f-a841-4b16-9ff3-367606ba5b33 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:18.184966 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1149e71f-a841-4b16-9ff3-367606ba5b33 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:18.186078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1149e71f-a841-4b16-9ff3-367606ba5b33 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1405 microversion: 2.20 time: 0.155905 Jul 11 14:19:18.186670 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 305/623] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:19:18 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:19:18.374916 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fbdbd7dd-208f-4756-a5cb-924892b729bb tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:18.375455 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fbdbd7dd-208f-4756-a5cb-924892b729bb tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:18.381543 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbdbd7dd-208f-4756-a5cb-924892b729bb tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:18.381996 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbdbd7dd-208f-4756-a5cb-924892b729bb tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:18.382796 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbdbd7dd-208f-4756-a5cb-924892b729bb tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:18.383242 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbdbd7dd-208f-4756-a5cb-924892b729bb tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:18.503773 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0e356702-a93f-4378-9392-1f04823a6241 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:18.504376 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0e356702-a93f-4378-9392-1f04823a6241 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:18.510399 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0e356702-a93f-4378-9392-1f04823a6241 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:18.510837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0e356702-a93f-4378-9392-1f04823a6241 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:18.511595 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0e356702-a93f-4378-9392-1f04823a6241 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:18.512025 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0e356702-a93f-4378-9392-1f04823a6241 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:18.515881 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fbdbd7dd-208f-4756-a5cb-924892b729bb tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:18.523525 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fbdbd7dd-208f-4756-a5cb-924892b729bb tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 200 len: 1513 microversion: 2.1 time: 0.153877 Jul 11 14:19:18.524117 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 319/624] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:18 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:18.649964 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0e356702-a93f-4378-9392-1f04823a6241 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:18.657699 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0e356702-a93f-4378-9392-1f04823a6241 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1266 microversion: 2.1 time: 0.158014 Jul 11 14:19:18.658310 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 306/625] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:18 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:18.863914 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a986f0e3-c87b-4e8a-9401-c549d9832a2d tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:18.864519 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a986f0e3-c87b-4e8a-9401-c549d9832a2d tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:18.872851 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a986f0e3-c87b-4e8a-9401-c549d9832a2d tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:18.873443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a986f0e3-c87b-4e8a-9401-c549d9832a2d tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:18.874118 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a986f0e3-c87b-4e8a-9401-c549d9832a2d tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:18.875195 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a986f0e3-c87b-4e8a-9401-c549d9832a2d tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:19.016818 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a986f0e3-c87b-4e8a-9401-c549d9832a2d tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:19.024578 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a986f0e3-c87b-4e8a-9401-c549d9832a2d tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1574 microversion: 2.1 time: 0.166810 Jul 11 14:19:19.025201 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 320/626] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:18 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:19.204110 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-09541092-2b86-4829-aa19-d895dbfa8860 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:19.204823 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-09541092-2b86-4829-aa19-d895dbfa8860 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:19.212105 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09541092-2b86-4829-aa19-d895dbfa8860 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:19.212480 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09541092-2b86-4829-aa19-d895dbfa8860 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:19.213272 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09541092-2b86-4829-aa19-d895dbfa8860 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:19.213705 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09541092-2b86-4829-aa19-d895dbfa8860 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:19.362811 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-09541092-2b86-4829-aa19-d895dbfa8860 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:19.372257 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-09541092-2b86-4829-aa19-d895dbfa8860 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:19.373913 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-09541092-2b86-4829-aa19-d895dbfa8860 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:19.375328 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-09541092-2b86-4829-aa19-d895dbfa8860 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1597 microversion: 2.20 time: 0.175220 Jul 11 14:19:19.375964 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 307/627] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:19:19 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1597 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:19:19.393309 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d7c4f882-70cc-427f-a711-d00c3e375b45 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:19.393850 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d7c4f882-70cc-427f-a711-d00c3e375b45 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:19.400021 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7c4f882-70cc-427f-a711-d00c3e375b45 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:19.400461 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7c4f882-70cc-427f-a711-d00c3e375b45 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:19.401212 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7c4f882-70cc-427f-a711-d00c3e375b45 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:19.401639 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7c4f882-70cc-427f-a711-d00c3e375b45 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:19.484842 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d7c4f882-70cc-427f-a711-d00c3e375b45 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095401 Jul 11 14:19:19.485453 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 321/628] 10.222.0.66 () {60 vars in 1315 bytes} [Mon Jul 11 14:19:19 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:19:19.540635 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2d432456-ea6a-4e55-8e8b-adb926f3a81a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:19.541243 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2d432456-ea6a-4e55-8e8b-adb926f3a81a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:19.547729 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2d432456-ea6a-4e55-8e8b-adb926f3a81a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:19.548170 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2d432456-ea6a-4e55-8e8b-adb926f3a81a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:19.548942 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2d432456-ea6a-4e55-8e8b-adb926f3a81a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:19.549367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2d432456-ea6a-4e55-8e8b-adb926f3a81a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:19.675418 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1f8ef16d-ff29-465d-bdb6-acf870603281 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:19.676034 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1f8ef16d-ff29-465d-bdb6-acf870603281 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:19.683054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1f8ef16d-ff29-465d-bdb6-acf870603281 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:19.683510 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1f8ef16d-ff29-465d-bdb6-acf870603281 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:19.684332 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1f8ef16d-ff29-465d-bdb6-acf870603281 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:19.684773 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1f8ef16d-ff29-465d-bdb6-acf870603281 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:19.702124 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2d432456-ea6a-4e55-8e8b-adb926f3a81a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:19.710126 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2d432456-ea6a-4e55-8e8b-adb926f3a81a tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 200 len: 1513 microversion: 2.1 time: 0.173263 Jul 11 14:19:19.710973 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 308/629] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:19 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:19.944151 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1f8ef16d-ff29-465d-bdb6-acf870603281 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:19.952724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1f8ef16d-ff29-465d-bdb6-acf870603281 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1266 microversion: 2.1 time: 0.281245 Jul 11 14:19:19.953718 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 322/630] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:19 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:20.042038 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b6f7a617-b23a-4e35-8bf9-1663581ce80f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:20.042689 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b6f7a617-b23a-4e35-8bf9-1663581ce80f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:20.048788 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b6f7a617-b23a-4e35-8bf9-1663581ce80f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:20.049240 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b6f7a617-b23a-4e35-8bf9-1663581ce80f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:20.050004 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b6f7a617-b23a-4e35-8bf9-1663581ce80f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:20.050462 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b6f7a617-b23a-4e35-8bf9-1663581ce80f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:20.190848 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b6f7a617-b23a-4e35-8bf9-1663581ce80f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:20.198411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b6f7a617-b23a-4e35-8bf9-1663581ce80f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1574 microversion: 2.1 time: 0.160213 Jul 11 14:19:20.199198 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 309/631] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:20 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:20.583416 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-ebe5c518-bc97-4540-8d8b-c826100bd769 req-44bc82a9-c611-4247-829d-3f16aeedc10a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c32b876-b642-4e8f-b446-3381d1f545f0", "tag": "b94eb482-2115-40ae-8818-8ffac7eba877"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:20.593700 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ebe5c518-bc97-4540-8d8b-c826100bd769 req-44bc82a9-c611-4247-829d-3f16aeedc10a service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:20.594148 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ebe5c518-bc97-4540-8d8b-c826100bd769 req-44bc82a9-c611-4247-829d-3f16aeedc10a service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:20.611488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-ebe5c518-bc97-4540-8d8b-c826100bd769 req-44bc82a9-c611-4247-829d-3f16aeedc10a service nova] Creating event network-changed:b94eb482-2115-40ae-8818-8ffac7eba877 for instance 5c32b876-b642-4e8f-b446-3381d1f545f0 on hv-cinder-81914 Jul 11 14:19:20.618810 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-ebe5c518-bc97-4540-8d8b-c826100bd769 req-44bc82a9-c611-4247-829d-3f16aeedc10a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040672 Jul 11 14:19:20.619743 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 323/632] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:19:20.727752 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9b28e2bc-7880-45a0-a77a-6c9f8769ed94 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:20.729204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9b28e2bc-7880-45a0-a77a-6c9f8769ed94 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:20.736628 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b28e2bc-7880-45a0-a77a-6c9f8769ed94 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:20.737473 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b28e2bc-7880-45a0-a77a-6c9f8769ed94 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:20.738522 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b28e2bc-7880-45a0-a77a-6c9f8769ed94 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:20.739173 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b28e2bc-7880-45a0-a77a-6c9f8769ed94 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:20.973947 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d5587ff6-7510-43de-baa0-7e067340304b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:20.974690 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d5587ff6-7510-43de-baa0-7e067340304b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:20.984486 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5587ff6-7510-43de-baa0-7e067340304b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:20.986478 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5587ff6-7510-43de-baa0-7e067340304b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:20.987661 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5587ff6-7510-43de-baa0-7e067340304b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:20.992551 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9b28e2bc-7880-45a0-a77a-6c9f8769ed94 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ade7dda2cc0a49beb162804d36977079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f9647b786a44948b284da50555b62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:21.001995 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5587ff6-7510-43de-baa0-7e067340304b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:21.014433 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9b28e2bc-7880-45a0-a77a-6c9f8769ed94 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 200 len: 1513 microversion: 2.1 time: 0.290362 Jul 11 14:19:21.030429 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 310/633] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:20 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 1513 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:21.191260 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-0ba7fe33-d702-4801-bc3b-0dc20ce7db89 req-ca5c8167-b418-49f8-a350-971deca46ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947f4a70-daac-4e48-9891-235b34895d99", "name": "network-vif-deleted", "tag": "008fa0a7-8c6e-4fc2-b49a-18d3b184a439"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:21.195941 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:21.208385 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-0ba7fe33-d702-4801-bc3b-0dc20ce7db89 req-ca5c8167-b418-49f8-a350-971deca46ea2 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:21.208630 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-0ba7fe33-d702-4801-bc3b-0dc20ce7db89 req-ca5c8167-b418-49f8-a350-971deca46ea2 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:21.236377 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-0ba7fe33-d702-4801-bc3b-0dc20ce7db89 req-ca5c8167-b418-49f8-a350-971deca46ea2 service nova] Creating event network-vif-deleted:008fa0a7-8c6e-4fc2-b49a-18d3b184a439 for instance 947f4a70-daac-4e48-9891-235b34895d99 on hv-cinder-81914 Jul 11 14:19:21.243027 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-0ba7fe33-d702-4801-bc3b-0dc20ce7db89 req-ca5c8167-b418-49f8-a350-971deca46ea2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059424 Jul 11 14:19:21.243817 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 311/634] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:19:21.249562 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0f9aaf63-b890-48b9-a5d1-9d363675756c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:21.250499 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0f9aaf63-b890-48b9-a5d1-9d363675756c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:21.257132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f9aaf63-b890-48b9-a5d1-9d363675756c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:21.257559 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f9aaf63-b890-48b9-a5d1-9d363675756c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:21.258401 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f9aaf63-b890-48b9-a5d1-9d363675756c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:21.258836 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f9aaf63-b890-48b9-a5d1-9d363675756c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:21.341328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d5587ff6-7510-43de-baa0-7e067340304b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:21.349854 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d5587ff6-7510-43de-baa0-7e067340304b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1266 microversion: 2.1 time: 0.380562 Jul 11 14:19:21.350755 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 324/635] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:20 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1266 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:21.455395 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0f9aaf63-b890-48b9-a5d1-9d363675756c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:21.463278 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0f9aaf63-b890-48b9-a5d1-9d363675756c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1574 microversion: 2.1 time: 0.218405 Jul 11 14:19:21.463875 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 312/636] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:21 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1574 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:22.037002 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4365a010-9158-4fd9-a101-7a1adff681e1 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:22.038443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4365a010-9158-4fd9-a101-7a1adff681e1 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] [instance: 947f4a70-daac-4e48-9891-235b34895d99] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:22.049465 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4365a010-9158-4fd9-a101-7a1adff681e1 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:22.050320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4365a010-9158-4fd9-a101-7a1adff681e1 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:22.051334 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4365a010-9158-4fd9-a101-7a1adff681e1 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:22.052204 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4365a010-9158-4fd9-a101-7a1adff681e1 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:22.070183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-4365a010-9158-4fd9-a101-7a1adff681e1 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] HTTP exception thrown: Instance 947f4a70-daac-4e48-9891-235b34895d99 could not be found. Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4365a010-9158-4fd9-a101-7a1adff681e1 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Request method failure captured: Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 HTTP/1.1 Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDD0fNJS0sr0qVqhq5ktbXDYA6SEfqZSpjRbXCxnjZ030fiszN_3UtHxe5LjDufraxk0JwzrhYoHinF-j4pAYOTpkMWJ7a7Apf2m65fUNtfb9ad9w8eZjnjYW16krE7dXiGyEw-k1zDlUfukkFqKzAHiG8MGKXgpjYNQHEsvpOSbk6Q Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 85f9647b786a44948b284da50555b62f Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1658299685 Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:19:22.071978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:19:22.073395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_85f9647b786a44948b284da50555b62f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/85f9647b786a44948b284da50555b62f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/85f9647b786a44948b284da50555b62f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/85f9647b786a44948b284da50555b62f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:19:22.073395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesSnapshotTestJSON-1658299685 Jul 11 14:19:22.073395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 85f9647b786a44948b284da50555b62f Jul 11 14:19:22.073395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1658299685 Jul 11 14:19:22.073395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesSnapshotTestJSON-1658299685-project Jul 11 14:19:22.073395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:19:22.073395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:19:22.073395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: ade7dda2cc0a49beb162804d36977079 Jul 11 14:19:22.073395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesSnapshotTestJSON-1658299685-project Jul 11 14:19:22.073395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:19:22.073395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance 947f4a70-daac-4e48-9891-235b34895d99 could not be found. Jul 11 14:19:22.073395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': '947f4a70-daac-4e48-9891-235b34895d99'} Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 947f4a70-daac-4e48-9891-235b34895d99 could not be found. Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:19:22.078932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:19:22.080516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:19:22.080516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:19:22.080516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:19:22.080516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:19:22.080516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:19:22.080516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:19:22.080516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:19:22.080516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 947f4a70-daac-4e48-9891-235b34895d99 could not be found. Jul 11 14:19:22.080516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:19:22.080516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:19:22.080516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:19:22.080516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:19:22.080516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:19:22.080516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:19:22.080516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:19:22.080516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:19:22.080516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 947f4a70-daac-4e48-9891-235b34895d99 could not be found. Jul 11 14:19:22.080516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:19:22.082407 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4365a010-9158-4fd9-a101-7a1adff681e1 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] Returning 404 to user: Instance 947f4a70-daac-4e48-9891-235b34895d99 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:19:22.082407 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4365a010-9158-4fd9-a101-7a1adff681e1 tempest-VolumesSnapshotTestJSON-1658299685 tempest-VolumesSnapshotTestJSON-1658299685-project] 10.222.0.66 "GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99" status: 404 len: 111 microversion: 2.1 time: 0.040462 Jul 11 14:19:22.082407 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 325/637] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:22 2022] GET /compute/v2.1/servers/947f4a70-daac-4e48-9891-235b34895d99 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:19:22.367782 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-880f7f07-0d02-4428-ae90-37181ff90cf7 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:22.368932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-880f7f07-0d02-4428-ae90-37181ff90cf7 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:22.376384 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-880f7f07-0d02-4428-ae90-37181ff90cf7 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:22.376833 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-880f7f07-0d02-4428-ae90-37181ff90cf7 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:22.377607 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-880f7f07-0d02-4428-ae90-37181ff90cf7 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:22.378040 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-880f7f07-0d02-4428-ae90-37181ff90cf7 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:22.481342 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bf883164-7544-46e6-a4df-8aada8eaaf06 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:22.482017 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bf883164-7544-46e6-a4df-8aada8eaaf06 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:22.488431 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf883164-7544-46e6-a4df-8aada8eaaf06 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:22.488918 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf883164-7544-46e6-a4df-8aada8eaaf06 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:22.489832 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf883164-7544-46e6-a4df-8aada8eaaf06 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:22.490403 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf883164-7544-46e6-a4df-8aada8eaaf06 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:22.515283 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-880f7f07-0d02-4428-ae90-37181ff90cf7 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:22.526694 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-880f7f07-0d02-4428-ae90-37181ff90cf7 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1266 microversion: 2.1 time: 0.162506 Jul 11 14:19:22.527215 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 313/638] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:22 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:22.635359 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bf883164-7544-46e6-a4df-8aada8eaaf06 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:22.644114 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bf883164-7544-46e6-a4df-8aada8eaaf06 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1574 microversion: 2.1 time: 0.167155 Jul 11 14:19:22.644603 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 326/639] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:22 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:23.411481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-822f7835-0b80-4f83-8135-060135e35c5e req-624eedc2-78a7-42fd-b11a-b497de44be1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374e3321-9408-4c7b-b2c3-8be5d7ed6561", "name": "network-vif-plugged", "status": "completed", "tag": "6d373871-6631-4afb-9527-c160464851a2"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:23.424529 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-822f7835-0b80-4f83-8135-060135e35c5e req-624eedc2-78a7-42fd-b11a-b497de44be1b service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:23.425047 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-822f7835-0b80-4f83-8135-060135e35c5e req-624eedc2-78a7-42fd-b11a-b497de44be1b service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:23.429253 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:23.440101 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-822f7835-0b80-4f83-8135-060135e35c5e req-624eedc2-78a7-42fd-b11a-b497de44be1b service nova] Creating event network-vif-plugged:6d373871-6631-4afb-9527-c160464851a2 for instance 374e3321-9408-4c7b-b2c3-8be5d7ed6561 on hv-cinder-81914 Jul 11 14:19:23.445152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-822f7835-0b80-4f83-8135-060135e35c5e req-624eedc2-78a7-42fd-b11a-b497de44be1b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037265 Jul 11 14:19:23.446274 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 314/640] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:19:23.544342 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb1e6768-836b-4c54-ab0b-f4a5027a6c6e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:23.545241 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cb1e6768-836b-4c54-ab0b-f4a5027a6c6e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:23.552965 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb1e6768-836b-4c54-ab0b-f4a5027a6c6e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:23.553856 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb1e6768-836b-4c54-ab0b-f4a5027a6c6e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:23.554789 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb1e6768-836b-4c54-ab0b-f4a5027a6c6e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:23.555612 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb1e6768-836b-4c54-ab0b-f4a5027a6c6e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:23.666195 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5860e511-51bc-47b3-8029-d33c405e1a9f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:23.666384 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5860e511-51bc-47b3-8029-d33c405e1a9f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:23.675011 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5860e511-51bc-47b3-8029-d33c405e1a9f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:23.675454 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5860e511-51bc-47b3-8029-d33c405e1a9f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:23.676259 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5860e511-51bc-47b3-8029-d33c405e1a9f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:23.676684 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5860e511-51bc-47b3-8029-d33c405e1a9f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:23.742401 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb1e6768-836b-4c54-ab0b-f4a5027a6c6e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:23.753158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cb1e6768-836b-4c54-ab0b-f4a5027a6c6e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1266 microversion: 2.1 time: 0.213261 Jul 11 14:19:23.753932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 327/641] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:23 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:23.828198 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5860e511-51bc-47b3-8029-d33c405e1a9f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:23.837305 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5860e511-51bc-47b3-8029-d33c405e1a9f tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1574 microversion: 2.1 time: 0.178423 Jul 11 14:19:23.842997 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 315/642] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:23 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:24.769807 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ef870c86-eab3-4b2c-a53b-d30153c257c3 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:24.770452 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ef870c86-eab3-4b2c-a53b-d30153c257c3 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:24.777228 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef870c86-eab3-4b2c-a53b-d30153c257c3 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:24.778267 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef870c86-eab3-4b2c-a53b-d30153c257c3 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:24.779037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef870c86-eab3-4b2c-a53b-d30153c257c3 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:24.779474 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef870c86-eab3-4b2c-a53b-d30153c257c3 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:24.855254 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8c5d1765-76c7-49ff-b704-5e6c3b36f602 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:24.855783 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8c5d1765-76c7-49ff-b704-5e6c3b36f602 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:24.862755 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8c5d1765-76c7-49ff-b704-5e6c3b36f602 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:24.863195 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8c5d1765-76c7-49ff-b704-5e6c3b36f602 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:24.863959 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8c5d1765-76c7-49ff-b704-5e6c3b36f602 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:24.864383 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8c5d1765-76c7-49ff-b704-5e6c3b36f602 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:24.912995 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ef870c86-eab3-4b2c-a53b-d30153c257c3 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:24.921101 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ef870c86-eab3-4b2c-a53b-d30153c257c3 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1266 microversion: 2.1 time: 0.155117 Jul 11 14:19:24.921685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 328/643] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:24 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:24.997892 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8c5d1765-76c7-49ff-b704-5e6c3b36f602 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:25.005666 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8c5d1765-76c7-49ff-b704-5e6c3b36f602 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1574 microversion: 2.1 time: 0.154335 Jul 11 14:19:25.006261 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 316/644] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:24 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:25.939850 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c4a17f6c-ca4a-4875-aaae-9f323d446ed1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:25.940468 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c4a17f6c-ca4a-4875-aaae-9f323d446ed1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:25.947398 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4a17f6c-ca4a-4875-aaae-9f323d446ed1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:25.947850 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4a17f6c-ca4a-4875-aaae-9f323d446ed1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:25.948651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4a17f6c-ca4a-4875-aaae-9f323d446ed1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:25.949142 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4a17f6c-ca4a-4875-aaae-9f323d446ed1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:26.023720 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-46401df7-4803-4272-880d-ab5340de6468 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:26.024337 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-46401df7-4803-4272-880d-ab5340de6468 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:26.031723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-46401df7-4803-4272-880d-ab5340de6468 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:26.032170 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-46401df7-4803-4272-880d-ab5340de6468 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:26.032935 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-46401df7-4803-4272-880d-ab5340de6468 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:26.033372 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-46401df7-4803-4272-880d-ab5340de6468 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:26.080713 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c4a17f6c-ca4a-4875-aaae-9f323d446ed1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:26.088412 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c4a17f6c-ca4a-4875-aaae-9f323d446ed1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1266 microversion: 2.1 time: 0.152415 Jul 11 14:19:26.088993 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 329/645] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:25 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:26.170600 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-46401df7-4803-4272-880d-ab5340de6468 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:26.178107 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-46401df7-4803-4272-880d-ab5340de6468 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1574 microversion: 2.1 time: 0.158284 Jul 11 14:19:26.178704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 317/646] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:26 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:27.105255 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d85e58ff-0388-442d-9948-72665ba52a0f tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:27.105880 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d85e58ff-0388-442d-9948-72665ba52a0f tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:27.108450 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=90 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:27.113625 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d85e58ff-0388-442d-9948-72665ba52a0f tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:27.114071 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d85e58ff-0388-442d-9948-72665ba52a0f tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:27.114872 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d85e58ff-0388-442d-9948-72665ba52a0f tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:27.115301 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d85e58ff-0388-442d-9948-72665ba52a0f tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:27.134626 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:27.252186 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5cfe0456-dc3c-4096-aecd-ea6e58d21647 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:27.252960 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5cfe0456-dc3c-4096-aecd-ea6e58d21647 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:27.258939 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d85e58ff-0388-442d-9948-72665ba52a0f tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:27.260250 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5cfe0456-dc3c-4096-aecd-ea6e58d21647 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:27.260931 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5cfe0456-dc3c-4096-aecd-ea6e58d21647 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:27.262461 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5cfe0456-dc3c-4096-aecd-ea6e58d21647 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:27.263123 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5cfe0456-dc3c-4096-aecd-ea6e58d21647 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:27.268441 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d85e58ff-0388-442d-9948-72665ba52a0f tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1266 microversion: 2.1 time: 0.166897 Jul 11 14:19:27.277921 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 330/647] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:27 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:27.277921 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-5926938c-9bf1-4117-87e0-ce9100ec245f req-36cd9911-d05e-46c8-bb2b-7d9943f94f13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be66bb60-a0c4-4db8-8eca-61debf0d1604", "name": "network-vif-plugged", "status": "completed", "tag": "de27be74-eeae-4fd8-9e66-9d465aca8acc"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:27.284004 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5926938c-9bf1-4117-87e0-ce9100ec245f req-36cd9911-d05e-46c8-bb2b-7d9943f94f13 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:27.284526 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5926938c-9bf1-4117-87e0-ce9100ec245f req-36cd9911-d05e-46c8-bb2b-7d9943f94f13 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:27.296636 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-5926938c-9bf1-4117-87e0-ce9100ec245f req-36cd9911-d05e-46c8-bb2b-7d9943f94f13 service nova] Creating event network-vif-plugged:de27be74-eeae-4fd8-9e66-9d465aca8acc for instance be66bb60-a0c4-4db8-8eca-61debf0d1604 on hv-cinder-81914 Jul 11 14:19:27.301909 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-5926938c-9bf1-4117-87e0-ce9100ec245f req-36cd9911-d05e-46c8-bb2b-7d9943f94f13 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031178 Jul 11 14:19:27.303047 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 331/648] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:19:27.411692 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5cfe0456-dc3c-4096-aecd-ea6e58d21647 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:27.420243 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5cfe0456-dc3c-4096-aecd-ea6e58d21647 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1574 microversion: 2.1 time: 0.172503 Jul 11 14:19:27.420740 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 318/649] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:27 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:28.162612 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c93b3ed8-0a62-4301-a295-f79fae09e281 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:28.163202 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c93b3ed8-0a62-4301-a295-f79fae09e281 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:28.170912 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c93b3ed8-0a62-4301-a295-f79fae09e281 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:28.171429 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c93b3ed8-0a62-4301-a295-f79fae09e281 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:28.172370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c93b3ed8-0a62-4301-a295-f79fae09e281 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:28.172863 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c93b3ed8-0a62-4301-a295-f79fae09e281 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:28.199928 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c93b3ed8-0a62-4301-a295-f79fae09e281 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/ips" status: 200 len: 147 microversion: 2.1 time: 0.041511 Jul 11 14:19:28.200729 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 332/650] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 11 14:19:28 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/ips => generated 147 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:19:28.286108 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a6142ce4-b973-4b03-950d-2b5c2bf89825 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:28.286981 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a6142ce4-b973-4b03-950d-2b5c2bf89825 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:28.293974 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a6142ce4-b973-4b03-950d-2b5c2bf89825 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:28.294473 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a6142ce4-b973-4b03-950d-2b5c2bf89825 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:28.295259 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a6142ce4-b973-4b03-950d-2b5c2bf89825 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:28.295695 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a6142ce4-b973-4b03-950d-2b5c2bf89825 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:28.438591 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f794d1be-9f59-41be-aec1-8ba6740aa10c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:28.439340 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f794d1be-9f59-41be-aec1-8ba6740aa10c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:28.441157 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a6142ce4-b973-4b03-950d-2b5c2bf89825 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:28.446121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f794d1be-9f59-41be-aec1-8ba6740aa10c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:28.446777 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f794d1be-9f59-41be-aec1-8ba6740aa10c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:28.447719 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f794d1be-9f59-41be-aec1-8ba6740aa10c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:28.448213 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f794d1be-9f59-41be-aec1-8ba6740aa10c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:28.452546 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a6142ce4-b973-4b03-950d-2b5c2bf89825 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1266 microversion: 2.1 time: 0.170189 Jul 11 14:19:28.453621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 319/651] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:28 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:28.604258 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f794d1be-9f59-41be-aec1-8ba6740aa10c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:28.613308 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f794d1be-9f59-41be-aec1-8ba6740aa10c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1561 microversion: 2.1 time: 0.179997 Jul 11 14:19:28.613879 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 333/652] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:28 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:29.471025 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0717440f-b742-4fd3-911c-12fa1925d0c8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:29.472283 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0717440f-b742-4fd3-911c-12fa1925d0c8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:29.481076 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0717440f-b742-4fd3-911c-12fa1925d0c8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:29.481977 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0717440f-b742-4fd3-911c-12fa1925d0c8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:29.483675 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0717440f-b742-4fd3-911c-12fa1925d0c8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:29.485156 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0717440f-b742-4fd3-911c-12fa1925d0c8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:29.551472 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-37b388d5-ca45-4763-837c-06c0716c4043 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6f1758d-986a-4e15-a5f2-4c471b81c043"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:29.552575 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-37b388d5-ca45-4763-837c-06c0716c4043 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:29.559725 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37b388d5-ca45-4763-837c-06c0716c4043 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:29.560182 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37b388d5-ca45-4763-837c-06c0716c4043 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:29.560971 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37b388d5-ca45-4763-837c-06c0716c4043 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:29.561413 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37b388d5-ca45-4763-837c-06c0716c4043 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:29.646848 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0717440f-b742-4fd3-911c-12fa1925d0c8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:29.655341 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0717440f-b742-4fd3-911c-12fa1925d0c8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1266 microversion: 2.1 time: 0.189128 Jul 11 14:19:29.656364 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 320/653] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:29 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:30.088364 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-37b388d5-ca45-4763-837c-06c0716c4043 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "POST /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.540796 Jul 11 14:19:30.088995 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 334/654] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 11 14:19:29 2022] POST /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments => generated 194 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:19:30.674274 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0168866a-8254-453f-813a-7729e23d6222 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:30.674909 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0168866a-8254-453f-813a-7729e23d6222 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:30.685681 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0168866a-8254-453f-813a-7729e23d6222 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:30.686252 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0168866a-8254-453f-813a-7729e23d6222 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:30.688096 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0168866a-8254-453f-813a-7729e23d6222 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:30.688554 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0168866a-8254-453f-813a-7729e23d6222 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:30.841534 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0168866a-8254-453f-813a-7729e23d6222 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:30.849182 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0168866a-8254-453f-813a-7729e23d6222 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1452 microversion: 2.1 time: 0.180689 Jul 11 14:19:30.849765 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 321/655] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:30 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:30.866534 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-def1fa69-a225-4ced-aa6e-95631609b326 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:30.867229 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-def1fa69-a225-4ced-aa6e-95631609b326 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:30.874487 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-def1fa69-a225-4ced-aa6e-95631609b326 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:30.874930 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-def1fa69-a225-4ced-aa6e-95631609b326 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:30.875704 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-def1fa69-a225-4ced-aa6e-95631609b326 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:30.876116 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-def1fa69-a225-4ced-aa6e-95631609b326 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:31.012379 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-def1fa69-a225-4ced-aa6e-95631609b326 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:31.020021 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-def1fa69-a225-4ced-aa6e-95631609b326 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1452 microversion: 2.1 time: 0.158109 Jul 11 14:19:31.020602 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 335/656] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:30 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:32.632376 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-5449c03b-fa9a-4be0-a744-fbed0868aae4 req-a21acd11-ca87-40cc-a8d7-52085a1157cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be66bb60-a0c4-4db8-8eca-61debf0d1604", "tag": "de27be74-eeae-4fd8-9e66-9d465aca8acc"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:32.641135 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-5449c03b-fa9a-4be0-a744-fbed0868aae4 req-a21acd11-ca87-40cc-a8d7-52085a1157cd service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:32.641582 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-5449c03b-fa9a-4be0-a744-fbed0868aae4 req-a21acd11-ca87-40cc-a8d7-52085a1157cd service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:32.653182 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-5449c03b-fa9a-4be0-a744-fbed0868aae4 req-a21acd11-ca87-40cc-a8d7-52085a1157cd service nova] Creating event network-changed:de27be74-eeae-4fd8-9e66-9d465aca8acc for instance be66bb60-a0c4-4db8-8eca-61debf0d1604 on hv-cinder-81914 Jul 11 14:19:32.658662 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-5449c03b-fa9a-4be0-a744-fbed0868aae4 req-a21acd11-ca87-40cc-a8d7-52085a1157cd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029855 Jul 11 14:19:32.659668 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 322/657] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:19:37.594492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aceab0f2-e1ff-4f11-b073-9e3055828e70 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:37.595539 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aceab0f2-e1ff-4f11-b073-9e3055828e70 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:37.602347 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aceab0f2-e1ff-4f11-b073-9e3055828e70 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:37.602887 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aceab0f2-e1ff-4f11-b073-9e3055828e70 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:37.603746 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aceab0f2-e1ff-4f11-b073-9e3055828e70 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:37.604308 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aceab0f2-e1ff-4f11-b073-9e3055828e70 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:37.636228 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aceab0f2-e1ff-4f11-b073-9e3055828e70 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045537 Jul 11 14:19:37.637031 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 336/658] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:19:37 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:19:37.648310 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5db75d96-8755-4e09-868d-b85be8576ddf tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:37.648910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5db75d96-8755-4e09-868d-b85be8576ddf tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:37.655562 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5db75d96-8755-4e09-868d-b85be8576ddf tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:37.656019 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5db75d96-8755-4e09-868d-b85be8576ddf tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:37.656796 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5db75d96-8755-4e09-868d-b85be8576ddf tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:37.657240 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5db75d96-8755-4e09-868d-b85be8576ddf tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:37.693088 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5db75d96-8755-4e09-868d-b85be8576ddf tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments/f6f1758d-986a-4e15-a5f2-4c471b81c043" status: 200 len: 194 microversion: 2.1 time: 0.049631 Jul 11 14:19:37.693702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 323/659] 10.222.0.66 () {58 vars in 1412 bytes} [Mon Jul 11 14:19:37 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments/f6f1758d-986a-4e15-a5f2-4c471b81c043 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:19:39.020257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6196f879-e2c7-4326-9ef4-ed7ede916015 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "741b1358-7f50-4430-b3f3-c681c204387f"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:39.021325 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6196f879-e2c7-4326-9ef4-ed7ede916015 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:39.028529 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6196f879-e2c7-4326-9ef4-ed7ede916015 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:39.028971 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6196f879-e2c7-4326-9ef4-ed7ede916015 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:39.029734 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6196f879-e2c7-4326-9ef4-ed7ede916015 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:39.030183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6196f879-e2c7-4326-9ef4-ed7ede916015 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:39.284510 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6196f879-e2c7-4326-9ef4-ed7ede916015 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "POST /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267921 Jul 11 14:19:39.285137 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 337/660] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 11 14:19:39 2022] POST /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:19:46.796451 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5e50c252-a22f-430e-ad61-65f8c2aa787d tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:46.797379 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5e50c252-a22f-430e-ad61-65f8c2aa787d tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:46.804051 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e50c252-a22f-430e-ad61-65f8c2aa787d tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:46.804534 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e50c252-a22f-430e-ad61-65f8c2aa787d tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:46.805301 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e50c252-a22f-430e-ad61-65f8c2aa787d tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:46.805733 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e50c252-a22f-430e-ad61-65f8c2aa787d tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:46.836417 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5e50c252-a22f-430e-ad61-65f8c2aa787d tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044499 Jul 11 14:19:46.836982 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 324/661] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:19:46 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:19:46.943137 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f2f44922-abb6-4140-9d5f-33ad5d2c1ebe tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:46.943684 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f2f44922-abb6-4140-9d5f-33ad5d2c1ebe tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:46.951328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f2f44922-abb6-4140-9d5f-33ad5d2c1ebe tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:46.951777 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f2f44922-abb6-4140-9d5f-33ad5d2c1ebe tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:46.952560 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f2f44922-abb6-4140-9d5f-33ad5d2c1ebe tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:46.953003 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f2f44922-abb6-4140-9d5f-33ad5d2c1ebe tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:46.981885 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f2f44922-abb6-4140-9d5f-33ad5d2c1ebe tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments/f6f1758d-986a-4e15-a5f2-4c471b81c043" status: 200 len: 194 microversion: 2.1 time: 0.043308 Jul 11 14:19:46.982510 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 338/662] 10.222.0.66 () {58 vars in 1412 bytes} [Mon Jul 11 14:19:46 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments/f6f1758d-986a-4e15-a5f2-4c471b81c043 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:19:46.992920 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-dbf1ad4d-c835-4cc4-8c18-7a09486d46da tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:46.993418 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-dbf1ad4d-c835-4cc4-8c18-7a09486d46da tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:46.999905 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbf1ad4d-c835-4cc4-8c18-7a09486d46da tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:47.000358 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbf1ad4d-c835-4cc4-8c18-7a09486d46da tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:47.001123 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbf1ad4d-c835-4cc4-8c18-7a09486d46da tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:47.001557 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbf1ad4d-c835-4cc4-8c18-7a09486d46da tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:47.123262 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-dbf1ad4d-c835-4cc4-8c18-7a09486d46da tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lazy-loading 'services' on Instance uuid f2c2d5cb-d011-4621-90f0-2fac11059be2 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:19:47.236997 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-dbf1ad4d-c835-4cc4-8c18-7a09486d46da tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments/f6f1758d-986a-4e15-a5f2-4c471b81c043" status: 202 len: 0 microversion: 2.1 time: 0.248228 Jul 11 14:19:47.237606 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 325/663] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 11 14:19:46 2022] DELETE /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments/f6f1758d-986a-4e15-a5f2-4c471b81c043 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:19:51.511473 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8cbf2c4e-af3f-42e4-bc92-9cef50580cc2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:51.512573 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8cbf2c4e-af3f-42e4-bc92-9cef50580cc2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:51.519163 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cbf2c4e-af3f-42e4-bc92-9cef50580cc2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:51.519639 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cbf2c4e-af3f-42e4-bc92-9cef50580cc2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:51.520398 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cbf2c4e-af3f-42e4-bc92-9cef50580cc2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:51.520829 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cbf2c4e-af3f-42e4-bc92-9cef50580cc2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:51.550540 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8cbf2c4e-af3f-42e4-bc92-9cef50580cc2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments/741b1358-7f50-4430-b3f3-c681c204387f" status: 200 len: 194 microversion: 2.1 time: 0.043446 Jul 11 14:19:51.551126 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 339/664] 10.222.0.66 () {58 vars in 1412 bytes} [Mon Jul 11 14:19:51 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments/741b1358-7f50-4430-b3f3-c681c204387f => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:19:51.562196 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0c58402d-3019-43c5-a0dd-fe9abad7a1ca tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:51.562791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0c58402d-3019-43c5-a0dd-fe9abad7a1ca tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:51.564751 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=30 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:51.570228 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c58402d-3019-43c5-a0dd-fe9abad7a1ca tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:51.570675 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c58402d-3019-43c5-a0dd-fe9abad7a1ca tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:51.571441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c58402d-3019-43c5-a0dd-fe9abad7a1ca tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:51.571872 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c58402d-3019-43c5-a0dd-fe9abad7a1ca tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:51.658451 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-0c58402d-3019-43c5-a0dd-fe9abad7a1ca tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lazy-loading 'services' on Instance uuid f2c2d5cb-d011-4621-90f0-2fac11059be2 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:19:51.728520 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0c58402d-3019-43c5-a0dd-fe9abad7a1ca tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments/741b1358-7f50-4430-b3f3-c681c204387f" status: 202 len: 0 microversion: 2.1 time: 0.171265 Jul 11 14:19:51.729108 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 326/665] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 11 14:19:51 2022] DELETE /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments/741b1358-7f50-4430-b3f3-c681c204387f => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:19:52.892857 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e9022567-b2ee-41f2-9627-8829ab2ba917 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:52.893794 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e9022567-b2ee-41f2-9627-8829ab2ba917 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:52.900443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9022567-b2ee-41f2-9627-8829ab2ba917 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:52.900894 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9022567-b2ee-41f2-9627-8829ab2ba917 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:52.901697 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9022567-b2ee-41f2-9627-8829ab2ba917 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:52.902139 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9022567-b2ee-41f2-9627-8829ab2ba917 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:52.932483 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e9022567-b2ee-41f2-9627-8829ab2ba917 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043585 Jul 11 14:19:52.933052 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 340/666] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:19:52 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 11 14:19:53.043664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fde76095-8002-4927-8437-807a5f7facb2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:53.044844 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fde76095-8002-4927-8437-807a5f7facb2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:53.051680 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fde76095-8002-4927-8437-807a5f7facb2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:53.052208 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fde76095-8002-4927-8437-807a5f7facb2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:53.053079 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fde76095-8002-4927-8437-807a5f7facb2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:53.053591 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fde76095-8002-4927-8437-807a5f7facb2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:53.083164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fde76095-8002-4927-8437-807a5f7facb2 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044247 Jul 11 14:19:53.083723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 327/667] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:19:53 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 14:19:53.146498 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-99162471-696d-415b-9b63-f515776f5670 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:53.147041 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-99162471-696d-415b-9b63-f515776f5670 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:53.153648 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99162471-696d-415b-9b63-f515776f5670 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:53.154121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99162471-696d-415b-9b63-f515776f5670 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:53.154922 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99162471-696d-415b-9b63-f515776f5670 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:53.155363 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99162471-696d-415b-9b63-f515776f5670 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:53.181472 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-99162471-696d-415b-9b63-f515776f5670 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:19:53.259899 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-99162471-696d-415b-9b63-f515776f5670 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 204 len: 0 microversion: 2.1 time: 0.117106 Jul 11 14:19:53.260459 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 341/668] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:19:53 2022] DELETE /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:19:53.269930 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9df3ee78-e57f-4348-9d27-f126bc383508 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:53.270572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9df3ee78-e57f-4348-9d27-f126bc383508 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:53.276625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9df3ee78-e57f-4348-9d27-f126bc383508 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:53.277073 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9df3ee78-e57f-4348-9d27-f126bc383508 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:53.278392 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9df3ee78-e57f-4348-9d27-f126bc383508 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:53.278941 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9df3ee78-e57f-4348-9d27-f126bc383508 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:53.414149 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9df3ee78-e57f-4348-9d27-f126bc383508 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:53.422670 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9df3ee78-e57f-4348-9d27-f126bc383508 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1674 microversion: 2.1 time: 0.156398 Jul 11 14:19:53.423077 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 328/669] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:53 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:54.440723 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c0fb862e-e5b1-472f-aa05-657e23c3821c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:54.441426 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c0fb862e-e5b1-472f-aa05-657e23c3821c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:54.450829 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0fb862e-e5b1-472f-aa05-657e23c3821c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:54.451649 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0fb862e-e5b1-472f-aa05-657e23c3821c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:54.453010 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0fb862e-e5b1-472f-aa05-657e23c3821c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:54.453470 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0fb862e-e5b1-472f-aa05-657e23c3821c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:54.679448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c0fb862e-e5b1-472f-aa05-657e23c3821c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:54.689621 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c0fb862e-e5b1-472f-aa05-657e23c3821c tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1674 microversion: 2.1 time: 0.253109 Jul 11 14:19:54.690343 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 342/670] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:54 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1674 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:55.707578 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-72c5d233-f9b5-4023-b92c-6edad61f5ef8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:55.708193 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-72c5d233-f9b5-4023-b92c-6edad61f5ef8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:55.715639 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-72c5d233-f9b5-4023-b92c-6edad61f5ef8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:55.716093 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-72c5d233-f9b5-4023-b92c-6edad61f5ef8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:55.716872 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-72c5d233-f9b5-4023-b92c-6edad61f5ef8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:55.717303 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-72c5d233-f9b5-4023-b92c-6edad61f5ef8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:55.720138 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:55.857248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-72c5d233-f9b5-4023-b92c-6edad61f5ef8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:55.865111 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-72c5d233-f9b5-4023-b92c-6edad61f5ef8 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1674 microversion: 2.1 time: 0.161456 Jul 11 14:19:55.865695 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 329/671] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:55 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:56.538430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-42fcf6bd-a4db-437f-aabc-5617f58497f3 req-e00e3f08-1a75-4339-93a4-0fc14d5318e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c2d5cb-d011-4621-90f0-2fac11059be2", "name": "network-vif-deleted", "tag": "1eaca124-07e0-4a06-9731-c5df81cfe7c9"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:56.549330 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-42fcf6bd-a4db-437f-aabc-5617f58497f3 req-e00e3f08-1a75-4339-93a4-0fc14d5318e0 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:56.549784 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-42fcf6bd-a4db-437f-aabc-5617f58497f3 req-e00e3f08-1a75-4339-93a4-0fc14d5318e0 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:56.562237 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-42fcf6bd-a4db-437f-aabc-5617f58497f3 req-e00e3f08-1a75-4339-93a4-0fc14d5318e0 service nova] Creating event network-vif-deleted:1eaca124-07e0-4a06-9731-c5df81cfe7c9 for instance f2c2d5cb-d011-4621-90f0-2fac11059be2 on hv-cinder-81914 Jul 11 14:19:56.568101 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-42fcf6bd-a4db-437f-aabc-5617f58497f3 req-e00e3f08-1a75-4339-93a4-0fc14d5318e0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033889 Jul 11 14:19:56.568724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 343/672] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:19:56.883506 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-44708aa6-3bcb-4a4d-9eb2-e09808e91445 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:56.884126 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-44708aa6-3bcb-4a4d-9eb2-e09808e91445 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:56.891186 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-44708aa6-3bcb-4a4d-9eb2-e09808e91445 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:56.891648 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-44708aa6-3bcb-4a4d-9eb2-e09808e91445 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:56.892424 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-44708aa6-3bcb-4a4d-9eb2-e09808e91445 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:56.892864 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-44708aa6-3bcb-4a4d-9eb2-e09808e91445 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:56.924601 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-44708aa6-3bcb-4a4d-9eb2-e09808e91445 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:56.925055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-44708aa6-3bcb-4a4d-9eb2-e09808e91445 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:56.925641 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-44708aa6-3bcb-4a4d-9eb2-e09808e91445 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lazy-loading 'fault' on Instance uuid f2c2d5cb-d011-4621-90f0-2fac11059be2 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:19:56.967624 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-44708aa6-3bcb-4a4d-9eb2-e09808e91445 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79023e778baa45888e6ef870499e5ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ad9d19847049c18d3bdc9f6e6c5168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:56.975514 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-44708aa6-3bcb-4a4d-9eb2-e09808e91445 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 200 len: 1328 microversion: 2.1 time: 0.095988 Jul 11 14:19:56.976336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 330/673] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:56 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 1328 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:57.998754 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-166a690f-e700-4487-ba7f-2c8b516d07f0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:57.999496 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-166a690f-e700-4487-ba7f-2c8b516d07f0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:58.001498 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:58.007948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-166a690f-e700-4487-ba7f-2c8b516d07f0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:58.008485 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-166a690f-e700-4487-ba7f-2c8b516d07f0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:58.009429 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-166a690f-e700-4487-ba7f-2c8b516d07f0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:58.009948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-166a690f-e700-4487-ba7f-2c8b516d07f0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:58.016265 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:58.027723 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-166a690f-e700-4487-ba7f-2c8b516d07f0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] HTTP exception thrown: Instance f2c2d5cb-d011-4621-90f0-2fac11059be2 could not be found. Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-166a690f-e700-4487-ba7f-2c8b516d07f0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Request method failure captured: Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 HTTP/1.1 Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDAJb9-VMz4Plu27RutXvf7coBuJE9-_YeT6TXHgSen1kLNO-8F8GBA0OQXFu7DZw9K7jxhjI1AKEjzTyUd4pE7sfnbyawbzaawX9Yapp8I29NtVKARAvyVI4p0nFE2qLIAXouyt0DAk8y4OaI7AN88Jlu4tbHXEGxgkyNWBlwY5hAw Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 15ad9d19847049c18d3bdc9f6e6c5168 Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-1518326899 Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:19:58.029927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:19:58.031638 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:19:58.031638 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-1518326899 Jul 11 14:19:58.031638 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 15ad9d19847049c18d3bdc9f6e6c5168 Jul 11 14:19:58.031638 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1518326899 Jul 11 14:19:58.031638 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-1518326899-project Jul 11 14:19:58.031638 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:19:58.031638 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:19:58.031638 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 79023e778baa45888e6ef870499e5ad8 Jul 11 14:19:58.031638 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-1518326899-project Jul 11 14:19:58.031638 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:19:58.031638 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance f2c2d5cb-d011-4621-90f0-2fac11059be2 could not be found. Jul 11 14:19:58.031638 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': 'f2c2d5cb-d011-4621-90f0-2fac11059be2'} Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2c2d5cb-d011-4621-90f0-2fac11059be2 could not be found. Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:19:58.032587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:19:58.034230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:19:58.034230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:19:58.034230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:19:58.034230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:19:58.034230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:19:58.034230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:19:58.034230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:19:58.034230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2c2d5cb-d011-4621-90f0-2fac11059be2 could not be found. Jul 11 14:19:58.034230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:19:58.034230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:19:58.034230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:19:58.034230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:19:58.034230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:19:58.034230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:19:58.034230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:19:58.034230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:19:58.034230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2c2d5cb-d011-4621-90f0-2fac11059be2 could not be found. Jul 11 14:19:58.034230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:19:58.035593 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-166a690f-e700-4487-ba7f-2c8b516d07f0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Returning 404 to user: Instance f2c2d5cb-d011-4621-90f0-2fac11059be2 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:19:58.035593 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-166a690f-e700-4487-ba7f-2c8b516d07f0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 404 len: 111 microversion: 2.1 time: 0.038859 Jul 11 14:19:58.035593 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 344/674] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:57 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:19:58.040595 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4f2cbdbb-060c-4b6b-b072-ead30cd9f6c0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '.version_select at 0x7fc976c2e160>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:58.059239 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4f2cbdbb-060c-4b6b-b072-ead30cd9f6c0 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094997154" status: 202 len: 0 microversion: 2.1 time: 0.021660 Jul 11 14:19:58.059974 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 331/675] 10.222.0.66 () {58 vars in 1220 bytes} [Mon Jul 11 14:19:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094997154 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:20:00.937435 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-609dbf78-fa15-470c-91e7-94cd50f78cef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:00.937943 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-609dbf78-fa15-470c-91e7-94cd50f78cef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:00.945131 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-609dbf78-fa15-470c-91e7-94cd50f78cef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:00.945569 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-609dbf78-fa15-470c-91e7-94cd50f78cef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:00.946363 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-609dbf78-fa15-470c-91e7-94cd50f78cef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:00.946796 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-609dbf78-fa15-470c-91e7-94cd50f78cef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:00.961095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-609dbf78-fa15-470c-91e7-94cd50f78cef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] HTTP exception thrown: Instance f2c2d5cb-d011-4621-90f0-2fac11059be2 could not be found. Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-609dbf78-fa15-470c-91e7-94cd50f78cef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Request method failure captured: Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 HTTP/1.1 Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDAJb9-VMz4Plu27RutXvf7coBuJE9-_YeT6TXHgSen1kLNO-8F8GBA0OQXFu7DZw9K7jxhjI1AKEjzTyUd4pE7sfnbyawbzaawX9Yapp8I29NtVKARAvyVI4p0nFE2qLIAXouyt0DAk8y4OaI7AN88Jlu4tbHXEGxgkyNWBlwY5hAw Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 15ad9d19847049c18d3bdc9f6e6c5168 Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-1518326899 Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:20:00.962655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:20:00.964187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:20:00.964187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-1518326899 Jul 11 14:20:00.964187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 15ad9d19847049c18d3bdc9f6e6c5168 Jul 11 14:20:00.964187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1518326899 Jul 11 14:20:00.964187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-1518326899-project Jul 11 14:20:00.964187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:20:00.964187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:20:00.964187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 79023e778baa45888e6ef870499e5ad8 Jul 11 14:20:00.964187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-1518326899-project Jul 11 14:20:00.964187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:20:00.964187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance f2c2d5cb-d011-4621-90f0-2fac11059be2 could not be found. Jul 11 14:20:00.964187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': 'f2c2d5cb-d011-4621-90f0-2fac11059be2'} Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2c2d5cb-d011-4621-90f0-2fac11059be2 could not be found. Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:20:00.965099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2c2d5cb-d011-4621-90f0-2fac11059be2 could not be found. Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2c2d5cb-d011-4621-90f0-2fac11059be2 could not be found. Jul 11 14:20:00.966730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:20:00.968288 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-609dbf78-fa15-470c-91e7-94cd50f78cef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Returning 404 to user: Instance f2c2d5cb-d011-4621-90f0-2fac11059be2 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:20:00.968288 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-609dbf78-fa15-470c-91e7-94cd50f78cef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 404 len: 111 microversion: 2.1 time: 0.031310 Jul 11 14:20:00.968288 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 345/676] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:20:00 2022] DELETE /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:20:00.972686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d989c875-d43a-47c7-8545-73b22c6067bb tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:00.973304 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d989c875-d43a-47c7-8545-73b22c6067bb tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: f2c2d5cb-d011-4621-90f0-2fac11059be2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:00.980569 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d989c875-d43a-47c7-8545-73b22c6067bb tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:00.981030 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d989c875-d43a-47c7-8545-73b22c6067bb tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:00.981806 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d989c875-d43a-47c7-8545-73b22c6067bb tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:00.982339 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d989c875-d43a-47c7-8545-73b22c6067bb tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:00.996738 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-d989c875-d43a-47c7-8545-73b22c6067bb tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] HTTP exception thrown: Instance f2c2d5cb-d011-4621-90f0-2fac11059be2 could not be found. Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d989c875-d43a-47c7-8545-73b22c6067bb tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Request method failure captured: Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 HTTP/1.1 Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDAJb9-VMz4Plu27RutXvf7coBuJE9-_YeT6TXHgSen1kLNO-8F8GBA0OQXFu7DZw9K7jxhjI1AKEjzTyUd4pE7sfnbyawbzaawX9Yapp8I29NtVKARAvyVI4p0nFE2qLIAXouyt0DAk8y4OaI7AN88Jlu4tbHXEGxgkyNWBlwY5hAw Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 15ad9d19847049c18d3bdc9f6e6c5168 Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeTestJSON-1518326899 Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:20:00.998702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:20:01.000323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:20:01.000323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeTestJSON-1518326899 Jul 11 14:20:01.000323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 15ad9d19847049c18d3bdc9f6e6c5168 Jul 11 14:20:01.000323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1518326899 Jul 11 14:20:01.000323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeTestJSON-1518326899-project Jul 11 14:20:01.000323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:20:01.000323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:20:01.000323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 79023e778baa45888e6ef870499e5ad8 Jul 11 14:20:01.000323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeTestJSON-1518326899-project Jul 11 14:20:01.000323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:20:01.000323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance f2c2d5cb-d011-4621-90f0-2fac11059be2 could not be found. Jul 11 14:20:01.000323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': 'f2c2d5cb-d011-4621-90f0-2fac11059be2'} Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2c2d5cb-d011-4621-90f0-2fac11059be2 could not be found. Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:20:01.002831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:20:01.004374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:20:01.004374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:20:01.004374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:20:01.004374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:20:01.004374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:20:01.004374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:20:01.004374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:20:01.004374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2c2d5cb-d011-4621-90f0-2fac11059be2 could not be found. Jul 11 14:20:01.004374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:20:01.004374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:20:01.004374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:20:01.004374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:20:01.004374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:20:01.004374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:20:01.004374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:20:01.004374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:20:01.004374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2c2d5cb-d011-4621-90f0-2fac11059be2 could not be found. Jul 11 14:20:01.004374 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:20:01.005659 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d989c875-d43a-47c7-8545-73b22c6067bb tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Returning 404 to user: Instance f2c2d5cb-d011-4621-90f0-2fac11059be2 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:20:01.005659 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d989c875-d43a-47c7-8545-73b22c6067bb tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2" status: 404 len: 111 microversion: 2.1 time: 0.031386 Jul 11 14:20:01.005659 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 332/677] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:00 2022] GET /compute/v2.1/servers/f2c2d5cb-d011-4621-90f0-2fac11059be2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:20:02.147278 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-74b70cf3-8c7f-47ce-bf41-4d5ebac993ef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:02.147812 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-74b70cf3-8c7f-47ce-bf41-4d5ebac993ef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:02.155366 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74b70cf3-8c7f-47ce-bf41-4d5ebac993ef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:02.155809 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74b70cf3-8c7f-47ce-bf41-4d5ebac993ef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:02.156573 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74b70cf3-8c7f-47ce-bf41-4d5ebac993ef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:02.157002 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74b70cf3-8c7f-47ce-bf41-4d5ebac993ef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:02.171751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-74b70cf3-8c7f-47ce-bf41-4d5ebac993ef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] HTTP exception thrown: Instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 could not be found. Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-74b70cf3-8c7f-47ce-bf41-4d5ebac993ef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Request method failure captured: Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 HTTP/1.1 Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDAJb9-VMz4Plu27RutXvf7coBuJE9-_YeT6TXHgSen1kLNO-8F8GBA0OQXFu7DZw9K7jxhjI1AKEjzTyUd4pE7sfnbyawbzaawX9Yapp8I29NtVKARAvyVI4p0nFE2qLIAXouyt0DAk8y4OaI7AN88Jlu4tbHXEGxgkyNWBlwY5hAw Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 15ad9d19847049c18d3bdc9f6e6c5168 Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-1518326899 Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:20:02.173299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:20:02.174895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:20:02.174895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-1518326899 Jul 11 14:20:02.174895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 15ad9d19847049c18d3bdc9f6e6c5168 Jul 11 14:20:02.174895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1518326899 Jul 11 14:20:02.174895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-1518326899-project Jul 11 14:20:02.174895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:20:02.174895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:20:02.174895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 79023e778baa45888e6ef870499e5ad8 Jul 11 14:20:02.174895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-1518326899-project Jul 11 14:20:02.174895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:20:02.174895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 could not be found. Jul 11 14:20:02.174895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': '22f5f00b-3f48-4d27-9330-2b61cfa19d27'} Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 could not be found. Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:20:02.175706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 could not be found. Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 could not be found. Jul 11 14:20:02.177158 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:20:02.178704 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-74b70cf3-8c7f-47ce-bf41-4d5ebac993ef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Returning 404 to user: Instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:20:02.178704 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-74b70cf3-8c7f-47ce-bf41-4d5ebac993ef tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "DELETE /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 404 len: 111 microversion: 2.1 time: 0.031354 Jul 11 14:20:02.178704 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 346/678] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:20:02 2022] DELETE /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:20:02.184506 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-deb730c3-f3f0-48ec-ae65-4b61943491c5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:02.185116 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-deb730c3-f3f0-48ec-ae65-4b61943491c5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] [instance: 22f5f00b-3f48-4d27-9330-2b61cfa19d27] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:02.191759 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-deb730c3-f3f0-48ec-ae65-4b61943491c5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:02.192211 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-deb730c3-f3f0-48ec-ae65-4b61943491c5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:02.192992 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-deb730c3-f3f0-48ec-ae65-4b61943491c5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:02.193403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-deb730c3-f3f0-48ec-ae65-4b61943491c5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:02.207984 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-deb730c3-f3f0-48ec-ae65-4b61943491c5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] HTTP exception thrown: Instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 could not be found. Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-deb730c3-f3f0-48ec-ae65-4b61943491c5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Request method failure captured: Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 HTTP/1.1 Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDAJb9-VMz4Plu27RutXvf7coBuJE9-_YeT6TXHgSen1kLNO-8F8GBA0OQXFu7DZw9K7jxhjI1AKEjzTyUd4pE7sfnbyawbzaawX9Yapp8I29NtVKARAvyVI4p0nFE2qLIAXouyt0DAk8y4OaI7AN88Jlu4tbHXEGxgkyNWBlwY5hAw Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 15ad9d19847049c18d3bdc9f6e6c5168 Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeTestJSON-1518326899 Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:20:02.209561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:20:02.211281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15ad9d19847049c18d3bdc9f6e6c5168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:20:02.211281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeTestJSON-1518326899 Jul 11 14:20:02.211281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 15ad9d19847049c18d3bdc9f6e6c5168 Jul 11 14:20:02.211281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1518326899 Jul 11 14:20:02.211281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeTestJSON-1518326899-project Jul 11 14:20:02.211281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:20:02.211281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:20:02.211281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 79023e778baa45888e6ef870499e5ad8 Jul 11 14:20:02.211281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeTestJSON-1518326899-project Jul 11 14:20:02.211281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:20:02.211281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 could not be found. Jul 11 14:20:02.211281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': '22f5f00b-3f48-4d27-9330-2b61cfa19d27'} Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 could not be found. Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:20:02.212248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:20:02.213465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:20:02.213465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:20:02.213465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:20:02.213465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:20:02.213465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:20:02.213465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:20:02.213465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:20:02.213465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 could not be found. Jul 11 14:20:02.213465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:20:02.213465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:20:02.213465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:20:02.213465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:20:02.213465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:20:02.213465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:20:02.213465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:20:02.213465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:20:02.213465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 could not be found. Jul 11 14:20:02.213465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:20:02.214665 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-deb730c3-f3f0-48ec-ae65-4b61943491c5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] Returning 404 to user: Instance 22f5f00b-3f48-4d27-9330-2b61cfa19d27 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:20:02.214665 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-deb730c3-f3f0-48ec-ae65-4b61943491c5 tempest-AttachVolumeTestJSON-1518326899 tempest-AttachVolumeTestJSON-1518326899-project] 10.222.0.66 "GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27" status: 404 len: 111 microversion: 2.1 time: 0.031178 Jul 11 14:20:02.214665 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 333/679] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:02 2022] GET /compute/v2.1/servers/22f5f00b-3f48-4d27-9330-2b61cfa19d27 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:20:07.526773 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5c593c39-4614-4106-b05a-aa5c40a69b33 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:07.527601 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5c593c39-4614-4106-b05a-aa5c40a69b33 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:07.534921 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c593c39-4614-4106-b05a-aa5c40a69b33 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:07.535379 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c593c39-4614-4106-b05a-aa5c40a69b33 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:07.536328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c593c39-4614-4106-b05a-aa5c40a69b33 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:07.536771 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c593c39-4614-4106-b05a-aa5c40a69b33 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:07.562323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5c593c39-4614-4106-b05a-aa5c40a69b33 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/ips" status: 200 len: 152 microversion: 2.20 time: 0.040699 Jul 11 14:20:07.562915 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 347/680] 10.222.0.66 () {60 vars in 1288 bytes} [Mon Jul 11 14:20:07 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:20:09.879661 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-26d01cc5-6ad6-493a-ace4-e869898f59aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:20:09.880859 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-26d01cc5-6ad6-493a-ace4-e869898f59aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:09.888702 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-26d01cc5-6ad6-493a-ace4-e869898f59aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:09.889414 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-26d01cc5-6ad6-493a-ace4-e869898f59aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:09.890417 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-26d01cc5-6ad6-493a-ace4-e869898f59aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:09.891039 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-26d01cc5-6ad6-493a-ace4-e869898f59aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:09.944892 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-26d01cc5-6ad6-493a-ace4-e869898f59aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lazy-loading 'flavor' on Instance uuid 5c32b876-b642-4e8f-b446-3381d1f545f0 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:20:10.296715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-26d01cc5-6ad6-493a-ace4-e869898f59aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "POST /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/action" status: 202 len: 0 microversion: 2.20 time: 0.428427 Jul 11 14:20:10.300377 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 334/681] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Jul 11 14:20:09 2022] POST /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:20:10.306631 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-83a35c58-9623-4153-a43a-6ca842860700 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:10.309707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-83a35c58-9623-4153-a43a-6ca842860700 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:10.323769 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83a35c58-9623-4153-a43a-6ca842860700 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:10.324325 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83a35c58-9623-4153-a43a-6ca842860700 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:10.326026 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83a35c58-9623-4153-a43a-6ca842860700 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:10.326656 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83a35c58-9623-4153-a43a-6ca842860700 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:10.513231 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-83a35c58-9623-4153-a43a-6ca842860700 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:10.522277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-83a35c58-9623-4153-a43a-6ca842860700 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:10.524061 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-83a35c58-9623-4153-a43a-6ca842860700 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:10.526699 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-83a35c58-9623-4153-a43a-6ca842860700 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1722 microversion: 2.20 time: 0.224861 Jul 11 14:20:10.527552 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 348/682] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:10 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:11.141117 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a3e2a1e8-4f65-40ec-a009-19e890c10a5f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Action: 'create', calling method: .version_select at 0x7fc976c16e50>, body: {"keypair": {"name": "tempest-keypair-1236296007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqWoaYFj3t/FuQqBKMPQH7aYz859GKQCyN2oWMEWyEQte7k7+MzaKA67lAXkcduO6K69rE+nbgnLPmYcDpx1Dgc1bwKroMHXSuLq4S9XEnWoNqvdVdwE43psTmIuvNzwg=="}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:20:11.157040 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-a3e2a1e8-4f65-40ec-a009-19e890c10a5f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Getting quotas for project 30c5e99c9761441fbad367a0bb8e1e66. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:20:11.160981 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-a3e2a1e8-4f65-40ec-a009-19e890c10a5f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Getting quotas for user 5bbea49c1a55481c9995f04f2e9b8618 and project 30c5e99c9761441fbad367a0bb8e1e66. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:20:11.183300 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a3e2a1e8-4f65-40ec-a009-19e890c10a5f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.159557 Jul 11 14:20:11.184149 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 335/683] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 11 14:20:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:20:11.546489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aeeeca97-900b-463e-94e4-a01cf3ce2978 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:11.547164 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aeeeca97-900b-463e-94e4-a01cf3ce2978 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:11.553597 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aeeeca97-900b-463e-94e4-a01cf3ce2978 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:11.554043 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aeeeca97-900b-463e-94e4-a01cf3ce2978 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:11.554849 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aeeeca97-900b-463e-94e4-a01cf3ce2978 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:11.555282 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aeeeca97-900b-463e-94e4-a01cf3ce2978 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:11.709360 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aeeeca97-900b-463e-94e4-a01cf3ce2978 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:11.719189 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aeeeca97-900b-463e-94e4-a01cf3ce2978 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:11.720799 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aeeeca97-900b-463e-94e4-a01cf3ce2978 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:11.722290 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aeeeca97-900b-463e-94e4-a01cf3ce2978 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1722 microversion: 2.20 time: 0.180652 Jul 11 14:20:11.722934 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 349/684] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:11 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:20:12.479770 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f9762e32-8d53-4658-833d-99219a5c9333 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1054257281", "imageRef": "67874ac7-fac8-4d6d-9cd1-9091ecb957b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "082c1f0c-e3fc-4cfb-9f28-88c9d2f15bb4"}], "security_groups": [{"name": "tempest-securitygroup--2128600835"}], "key_name": "tempest-keypair-1236296007", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:20:12.589424 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-f9762e32-8d53-4658-833d-99219a5c9333 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] validate_networks() for [('082c1f0c-e3fc-4cfb-9f28-88c9d2f15bb4', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:20:12.741612 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-95117002-70af-4933-91d9-8ab33f32e6e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:12.742202 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-95117002-70af-4933-91d9-8ab33f32e6e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:12.751155 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95117002-70af-4933-91d9-8ab33f32e6e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:12.751604 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95117002-70af-4933-91d9-8ab33f32e6e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:12.752405 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95117002-70af-4933-91d9-8ab33f32e6e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:12.752843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95117002-70af-4933-91d9-8ab33f32e6e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:12.922103 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-95117002-70af-4933-91d9-8ab33f32e6e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:12.931242 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-95117002-70af-4933-91d9-8ab33f32e6e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:12.933538 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-95117002-70af-4933-91d9-8ab33f32e6e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:12.934837 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-95117002-70af-4933-91d9-8ab33f32e6e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1722 microversion: 2.20 time: 0.197878 Jul 11 14:20:12.935390 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 350/685] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:12 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:13.007955 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-f9762e32-8d53-4658-833d-99219a5c9333 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:20:13.008405 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-f9762e32-8d53-4658-833d-99219a5c9333 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:20:13.008979 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-f9762e32-8d53-4658-833d-99219a5c9333 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:20:13.009939 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-f9762e32-8d53-4658-833d-99219a5c9333 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:20:13.010410 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-f9762e32-8d53-4658-833d-99219a5c9333 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:20:13.024487 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9762e32-8d53-4658-833d-99219a5c9333 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:13.024939 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9762e32-8d53-4658-833d-99219a5c9333 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:13.025747 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9762e32-8d53-4658-833d-99219a5c9333 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:13.026698 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9762e32-8d53-4658-833d-99219a5c9333 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:13.046696 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-f9762e32-8d53-4658-833d-99219a5c9333 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Getting quotas for project 30c5e99c9761441fbad367a0bb8e1e66. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:20:13.051698 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-f9762e32-8d53-4658-833d-99219a5c9333 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Getting quotas for user 5bbea49c1a55481c9995f04f2e9b8618 and project 30c5e99c9761441fbad367a0bb8e1e66. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:20:13.064182 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f9762e32-8d53-4658-833d-99219a5c9333 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:20:13.066602 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f9762e32-8d53-4658-833d-99219a5c9333 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67874ac7-fac8-4d6d-9cd1-9091ecb957b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:20:13.124582 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f9762e32-8d53-4658-833d-99219a5c9333 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.648101 Jul 11 14:20:13.125267 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 336/686] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:20:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:20:13.137374 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5413e6ff-5c5c-4060-be91-cf030bd4b4f2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:13.138388 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5413e6ff-5c5c-4060-be91-cf030bd4b4f2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:13.202843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5413e6ff-5c5c-4060-be91-cf030bd4b4f2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:13.215350 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5413e6ff-5c5c-4060-be91-cf030bd4b4f2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e" status: 200 len: 1242 microversion: 2.1 time: 0.083801 Jul 11 14:20:13.216300 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 351/687] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:13 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:20:13.954459 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8083750e-e439-4054-8901-29131626df66 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:13.955090 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8083750e-e439-4054-8901-29131626df66 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:13.964883 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8083750e-e439-4054-8901-29131626df66 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:13.965980 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8083750e-e439-4054-8901-29131626df66 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:13.967209 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8083750e-e439-4054-8901-29131626df66 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:13.967993 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8083750e-e439-4054-8901-29131626df66 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:14.112189 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8083750e-e439-4054-8901-29131626df66 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:14.121777 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8083750e-e439-4054-8901-29131626df66 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:14.124237 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8083750e-e439-4054-8901-29131626df66 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:14.125728 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8083750e-e439-4054-8901-29131626df66 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1722 microversion: 2.20 time: 0.175769 Jul 11 14:20:14.126413 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 337/688] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:13 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:14.233467 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-267d631e-30e8-4e68-8177-ba8286fe3485 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:14.234387 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-267d631e-30e8-4e68-8177-ba8286fe3485 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:14.241704 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-267d631e-30e8-4e68-8177-ba8286fe3485 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:14.242223 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-267d631e-30e8-4e68-8177-ba8286fe3485 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:14.243508 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-267d631e-30e8-4e68-8177-ba8286fe3485 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:14.243961 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-267d631e-30e8-4e68-8177-ba8286fe3485 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:14.338846 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-267d631e-30e8-4e68-8177-ba8286fe3485 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:14.349533 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-267d631e-30e8-4e68-8177-ba8286fe3485 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e" status: 200 len: 1302 microversion: 2.1 time: 0.120390 Jul 11 14:20:14.350127 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 352/689] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:14 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e => generated 1302 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:20:15.145520 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1fc98a39-4d3e-4d98-add6-7f9a5d0233f6 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:15.146138 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1fc98a39-4d3e-4d98-add6-7f9a5d0233f6 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:15.155539 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1fc98a39-4d3e-4d98-add6-7f9a5d0233f6 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:15.156348 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1fc98a39-4d3e-4d98-add6-7f9a5d0233f6 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:15.157207 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1fc98a39-4d3e-4d98-add6-7f9a5d0233f6 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:15.157785 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1fc98a39-4d3e-4d98-add6-7f9a5d0233f6 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:15.309941 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1fc98a39-4d3e-4d98-add6-7f9a5d0233f6 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:15.317948 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1fc98a39-4d3e-4d98-add6-7f9a5d0233f6 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:15.319488 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1fc98a39-4d3e-4d98-add6-7f9a5d0233f6 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:15.320637 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1fc98a39-4d3e-4d98-add6-7f9a5d0233f6 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1722 microversion: 2.20 time: 0.179413 Jul 11 14:20:15.321219 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 338/690] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:15 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:15.367191 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bff1ec89-26bd-475b-97a6-0c277e5ed849 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:15.367808 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bff1ec89-26bd-475b-97a6-0c277e5ed849 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:15.375488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bff1ec89-26bd-475b-97a6-0c277e5ed849 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:15.375855 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bff1ec89-26bd-475b-97a6-0c277e5ed849 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:15.376642 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bff1ec89-26bd-475b-97a6-0c277e5ed849 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:15.377078 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bff1ec89-26bd-475b-97a6-0c277e5ed849 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:15.589255 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bff1ec89-26bd-475b-97a6-0c277e5ed849 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:15.596964 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bff1ec89-26bd-475b-97a6-0c277e5ed849 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e" status: 200 len: 1368 microversion: 2.1 time: 0.233668 Jul 11 14:20:15.597571 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 353/691] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:15 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:20:16.183578 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-2c460a20-a3d9-4ccb-9b75-8caf526cef2a req-27ebd38e-8c56-4129-bc5f-a6778637511e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de5ec3b0-8851-4d21-a2ec-5a3e5487d73e", "tag": "90500653-99cd-4737-b71c-792e2ce9a238"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:20:16.193365 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-2c460a20-a3d9-4ccb-9b75-8caf526cef2a req-27ebd38e-8c56-4129-bc5f-a6778637511e service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:16.194050 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-2c460a20-a3d9-4ccb-9b75-8caf526cef2a req-27ebd38e-8c56-4129-bc5f-a6778637511e service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:16.241246 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-2c460a20-a3d9-4ccb-9b75-8caf526cef2a req-27ebd38e-8c56-4129-bc5f-a6778637511e service nova] Creating event network-changed:90500653-99cd-4737-b71c-792e2ce9a238 for instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e on hv-cinder-81914 Jul 11 14:20:16.248467 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-2c460a20-a3d9-4ccb-9b75-8caf526cef2a req-27ebd38e-8c56-4129-bc5f-a6778637511e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068446 Jul 11 14:20:16.250094 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 339/692] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:20:16.341418 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0c281c62-f0f2-40eb-9b49-da213225176d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:16.342071 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0c281c62-f0f2-40eb-9b49-da213225176d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:16.349758 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c281c62-f0f2-40eb-9b49-da213225176d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:16.350233 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c281c62-f0f2-40eb-9b49-da213225176d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:16.351087 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c281c62-f0f2-40eb-9b49-da213225176d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:16.351468 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c281c62-f0f2-40eb-9b49-da213225176d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:16.543369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c281c62-f0f2-40eb-9b49-da213225176d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:16.552165 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c281c62-f0f2-40eb-9b49-da213225176d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:16.553694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c281c62-f0f2-40eb-9b49-da213225176d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:16.554910 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0c281c62-f0f2-40eb-9b49-da213225176d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1722 microversion: 2.20 time: 0.218561 Jul 11 14:20:16.555493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 354/693] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:16 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:16.615369 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e92328b8-bfe2-4c67-b9b5-588d4493a94b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:16.616146 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e92328b8-bfe2-4c67-b9b5-588d4493a94b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:16.624049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e92328b8-bfe2-4c67-b9b5-588d4493a94b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:16.624533 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e92328b8-bfe2-4c67-b9b5-588d4493a94b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:16.625378 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e92328b8-bfe2-4c67-b9b5-588d4493a94b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:16.625851 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e92328b8-bfe2-4c67-b9b5-588d4493a94b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:16.768965 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e92328b8-bfe2-4c67-b9b5-588d4493a94b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:16.777512 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e92328b8-bfe2-4c67-b9b5-588d4493a94b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e" status: 200 len: 1368 microversion: 2.1 time: 0.166868 Jul 11 14:20:16.778104 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 340/694] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:16 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:20:17.573909 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4b0cdd34-7669-4b11-8d2d-eea410638d2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:17.574567 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4b0cdd34-7669-4b11-8d2d-eea410638d2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:17.581101 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b0cdd34-7669-4b11-8d2d-eea410638d2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:17.581548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b0cdd34-7669-4b11-8d2d-eea410638d2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:17.582350 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b0cdd34-7669-4b11-8d2d-eea410638d2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:17.582795 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b0cdd34-7669-4b11-8d2d-eea410638d2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:17.793514 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-309acfd7-652c-4852-800a-9126d4113834 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:17.794125 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-309acfd7-652c-4852-800a-9126d4113834 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:17.800615 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-309acfd7-652c-4852-800a-9126d4113834 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:17.801069 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-309acfd7-652c-4852-800a-9126d4113834 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:17.801858 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-309acfd7-652c-4852-800a-9126d4113834 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:17.802299 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-309acfd7-652c-4852-800a-9126d4113834 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:17.809376 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b0cdd34-7669-4b11-8d2d-eea410638d2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:17.817722 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b0cdd34-7669-4b11-8d2d-eea410638d2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:17.819471 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b0cdd34-7669-4b11-8d2d-eea410638d2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:17.820784 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4b0cdd34-7669-4b11-8d2d-eea410638d2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1722 microversion: 2.20 time: 0.251760 Jul 11 14:20:17.821445 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 355/695] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:17 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:17.941798 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-309acfd7-652c-4852-800a-9126d4113834 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:17.950545 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-309acfd7-652c-4852-800a-9126d4113834 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e" status: 200 len: 1368 microversion: 2.1 time: 0.160958 Jul 11 14:20:17.951135 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 341/696] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:17 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:20:18.841295 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-04a1a55f-780e-4c86-8538-359baf6ac687 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:18.841843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-04a1a55f-780e-4c86-8538-359baf6ac687 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:18.848637 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04a1a55f-780e-4c86-8538-359baf6ac687 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:18.849090 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04a1a55f-780e-4c86-8538-359baf6ac687 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:18.849876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04a1a55f-780e-4c86-8538-359baf6ac687 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:18.852273 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04a1a55f-780e-4c86-8538-359baf6ac687 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:18.968042 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7a5c6fd2-8610-4db9-93e8-dcec1b5f2f82 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:18.968663 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7a5c6fd2-8610-4db9-93e8-dcec1b5f2f82 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:18.976190 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7a5c6fd2-8610-4db9-93e8-dcec1b5f2f82 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:18.976715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7a5c6fd2-8610-4db9-93e8-dcec1b5f2f82 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:18.977532 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7a5c6fd2-8610-4db9-93e8-dcec1b5f2f82 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:18.978699 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7a5c6fd2-8610-4db9-93e8-dcec1b5f2f82 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:18.989286 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-04a1a55f-780e-4c86-8538-359baf6ac687 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:18.998440 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-04a1a55f-780e-4c86-8538-359baf6ac687 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:18.999730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-04a1a55f-780e-4c86-8538-359baf6ac687 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:19.001100 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-04a1a55f-780e-4c86-8538-359baf6ac687 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1722 microversion: 2.20 time: 0.164618 Jul 11 14:20:19.001672 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 356/697] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:18 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:19.115869 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7a5c6fd2-8610-4db9-93e8-dcec1b5f2f82 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:19.124366 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7a5c6fd2-8610-4db9-93e8-dcec1b5f2f82 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e" status: 200 len: 1368 microversion: 2.1 time: 0.160794 Jul 11 14:20:19.124937 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 342/698] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:18 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:20:20.019548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3594ad7c-51dd-4cf3-af28-4282e5bd9193 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:20.020150 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3594ad7c-51dd-4cf3-af28-4282e5bd9193 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:20.026807 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3594ad7c-51dd-4cf3-af28-4282e5bd9193 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:20.027271 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3594ad7c-51dd-4cf3-af28-4282e5bd9193 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:20.028051 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3594ad7c-51dd-4cf3-af28-4282e5bd9193 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:20.028493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3594ad7c-51dd-4cf3-af28-4282e5bd9193 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:20.141303 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-546bf43f-a385-41c3-8678-f9752114ce28 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:20.141971 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-546bf43f-a385-41c3-8678-f9752114ce28 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:20.148549 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-546bf43f-a385-41c3-8678-f9752114ce28 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:20.149001 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-546bf43f-a385-41c3-8678-f9752114ce28 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:20.149776 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-546bf43f-a385-41c3-8678-f9752114ce28 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:20.150319 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-546bf43f-a385-41c3-8678-f9752114ce28 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:20.165295 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3594ad7c-51dd-4cf3-af28-4282e5bd9193 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:20.174077 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3594ad7c-51dd-4cf3-af28-4282e5bd9193 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:20.175575 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3594ad7c-51dd-4cf3-af28-4282e5bd9193 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:20.176990 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3594ad7c-51dd-4cf3-af28-4282e5bd9193 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1722 microversion: 2.20 time: 0.161236 Jul 11 14:20:20.186702 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 357/699] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:20 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:20.290757 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-546bf43f-a385-41c3-8678-f9752114ce28 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:20.299100 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-546bf43f-a385-41c3-8678-f9752114ce28 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e" status: 200 len: 1368 microversion: 2.1 time: 0.161697 Jul 11 14:20:20.299674 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 343/700] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:20 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:20:21.196598 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1e8ed3e6-e89e-4a29-a948-25b9aee304fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:21.197286 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1e8ed3e6-e89e-4a29-a948-25b9aee304fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:21.204338 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e8ed3e6-e89e-4a29-a948-25b9aee304fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:21.204797 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e8ed3e6-e89e-4a29-a948-25b9aee304fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:21.205570 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e8ed3e6-e89e-4a29-a948-25b9aee304fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:21.206003 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e8ed3e6-e89e-4a29-a948-25b9aee304fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:21.317593 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fa0b18fe-3fbc-490b-ae1a-82b56a56217d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:21.318254 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fa0b18fe-3fbc-490b-ae1a-82b56a56217d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:21.325698 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa0b18fe-3fbc-490b-ae1a-82b56a56217d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:21.326811 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa0b18fe-3fbc-490b-ae1a-82b56a56217d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:21.328002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa0b18fe-3fbc-490b-ae1a-82b56a56217d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:21.328655 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa0b18fe-3fbc-490b-ae1a-82b56a56217d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:21.389869 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1e8ed3e6-e89e-4a29-a948-25b9aee304fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:21.400033 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1e8ed3e6-e89e-4a29-a948-25b9aee304fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:21.402142 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1e8ed3e6-e89e-4a29-a948-25b9aee304fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:21.403734 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1e8ed3e6-e89e-4a29-a948-25b9aee304fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1743 microversion: 2.20 time: 0.211267 Jul 11 14:20:21.404672 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 358/701] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:21 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1743 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:21.493847 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fa0b18fe-3fbc-490b-ae1a-82b56a56217d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:21.503488 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fa0b18fe-3fbc-490b-ae1a-82b56a56217d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e" status: 200 len: 1368 microversion: 2.1 time: 0.191002 Jul 11 14:20:21.504189 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 344/702] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:21 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:20:21.518526 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-710c866a-646e-41ea-ad47-f8eb769141a2 req-46b1f877-cef0-4e07-a5cf-040bdcc7ad48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de5ec3b0-8851-4d21-a2ec-5a3e5487d73e", "name": "network-vif-plugged", "status": "completed", "tag": "90500653-99cd-4737-b71c-792e2ce9a238"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:20:21.527852 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-710c866a-646e-41ea-ad47-f8eb769141a2 req-46b1f877-cef0-4e07-a5cf-040bdcc7ad48 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:21.528300 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-710c866a-646e-41ea-ad47-f8eb769141a2 req-46b1f877-cef0-4e07-a5cf-040bdcc7ad48 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:21.540407 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-710c866a-646e-41ea-ad47-f8eb769141a2 req-46b1f877-cef0-4e07-a5cf-040bdcc7ad48 service nova] Creating event network-vif-plugged:90500653-99cd-4737-b71c-792e2ce9a238 for instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e on hv-cinder-81914 Jul 11 14:20:21.546554 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-710c866a-646e-41ea-ad47-f8eb769141a2 req-46b1f877-cef0-4e07-a5cf-040bdcc7ad48 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031985 Jul 11 14:20:21.547389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 359/703] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:20:22.421476 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3ecfe1c8-eb3f-4bc0-a1e8-7b4fb4905f2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:22.422118 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3ecfe1c8-eb3f-4bc0-a1e8-7b4fb4905f2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:22.424523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:22.430395 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ecfe1c8-eb3f-4bc0-a1e8-7b4fb4905f2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:22.430847 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ecfe1c8-eb3f-4bc0-a1e8-7b4fb4905f2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:22.431615 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ecfe1c8-eb3f-4bc0-a1e8-7b4fb4905f2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:22.432699 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ecfe1c8-eb3f-4bc0-a1e8-7b4fb4905f2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:22.520907 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d8207896-f2ec-49d6-b9b4-b8516ea130fd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:22.521618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d8207896-f2ec-49d6-b9b4-b8516ea130fd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:22.529060 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8207896-f2ec-49d6-b9b4-b8516ea130fd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:22.529516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8207896-f2ec-49d6-b9b4-b8516ea130fd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:22.530336 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8207896-f2ec-49d6-b9b4-b8516ea130fd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:22.530781 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8207896-f2ec-49d6-b9b4-b8516ea130fd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:22.566550 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3ecfe1c8-eb3f-4bc0-a1e8-7b4fb4905f2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:22.575010 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3ecfe1c8-eb3f-4bc0-a1e8-7b4fb4905f2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:22.576542 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3ecfe1c8-eb3f-4bc0-a1e8-7b4fb4905f2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:22.577737 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3ecfe1c8-eb3f-4bc0-a1e8-7b4fb4905f2e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1743 microversion: 2.20 time: 0.160195 Jul 11 14:20:22.578329 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 345/704] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:22 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:22.663372 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d8207896-f2ec-49d6-b9b4-b8516ea130fd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:22.670973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d8207896-f2ec-49d6-b9b4-b8516ea130fd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e" status: 200 len: 1368 microversion: 2.1 time: 0.154289 Jul 11 14:20:22.671558 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 360/705] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:22 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:20:23.596245 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c91817c4-6328-4b42-b699-23a9db2c10f0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:23.596854 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c91817c4-6328-4b42-b699-23a9db2c10f0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:23.598734 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:23.599381 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=10 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:23.606321 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c91817c4-6328-4b42-b699-23a9db2c10f0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:23.606771 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c91817c4-6328-4b42-b699-23a9db2c10f0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:23.607526 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c91817c4-6328-4b42-b699-23a9db2c10f0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:23.607953 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c91817c4-6328-4b42-b699-23a9db2c10f0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:23.687761 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1f813bbf-3866-4355-bda1-566afce39111 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:23.688424 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1f813bbf-3866-4355-bda1-566afce39111 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:23.694565 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:23.698060 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1f813bbf-3866-4355-bda1-566afce39111 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:23.698827 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1f813bbf-3866-4355-bda1-566afce39111 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:23.699644 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1f813bbf-3866-4355-bda1-566afce39111 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:23.700263 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1f813bbf-3866-4355-bda1-566afce39111 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:23.788646 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c91817c4-6328-4b42-b699-23a9db2c10f0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:23.800362 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c91817c4-6328-4b42-b699-23a9db2c10f0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:23.804357 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c91817c4-6328-4b42-b699-23a9db2c10f0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:23.805592 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c91817c4-6328-4b42-b699-23a9db2c10f0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1743 microversion: 2.20 time: 0.213430 Jul 11 14:20:23.807032 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 346/706] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:23 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1743 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:23.878721 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1f813bbf-3866-4355-bda1-566afce39111 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:23.887117 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1f813bbf-3866-4355-bda1-566afce39111 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e" status: 200 len: 1559 microversion: 2.1 time: 0.203274 Jul 11 14:20:23.887701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 361/707] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:23 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e => generated 1559 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:20:23.904197 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3382a82e-837f-4e64-b70d-8e19b39f933f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:23.904700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3382a82e-837f-4e64-b70d-8e19b39f933f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:23.910810 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3382a82e-837f-4e64-b70d-8e19b39f933f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:23.911259 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3382a82e-837f-4e64-b70d-8e19b39f933f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:23.912025 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3382a82e-837f-4e64-b70d-8e19b39f933f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:23.912460 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3382a82e-837f-4e64-b70d-8e19b39f933f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:23.994150 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3382a82e-837f-4e64-b70d-8e19b39f933f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094619 Jul 11 14:20:23.995637 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 347/708] 10.222.0.66 () {58 vars in 1274 bytes} [Mon Jul 11 14:20:23 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:20:24.827049 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0c65ab60-7011-4eb1-a331-d4d56d20b69d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:24.828258 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0c65ab60-7011-4eb1-a331-d4d56d20b69d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:24.848813 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c65ab60-7011-4eb1-a331-d4d56d20b69d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:24.849274 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c65ab60-7011-4eb1-a331-d4d56d20b69d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:24.850066 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c65ab60-7011-4eb1-a331-d4d56d20b69d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:24.850545 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c65ab60-7011-4eb1-a331-d4d56d20b69d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:25.040964 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-0f1a1804-e006-4f99-88d9-d549f981c066 req-da1bc930-6e90-497d-ac72-7e61ef9ed15e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de5ec3b0-8851-4d21-a2ec-5a3e5487d73e", "tag": "90500653-99cd-4737-b71c-792e2ce9a238"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:20:25.050921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-0f1a1804-e006-4f99-88d9-d549f981c066 req-da1bc930-6e90-497d-ac72-7e61ef9ed15e service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:25.051367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-0f1a1804-e006-4f99-88d9-d549f981c066 req-da1bc930-6e90-497d-ac72-7e61ef9ed15e service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:25.070260 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-0f1a1804-e006-4f99-88d9-d549f981c066 req-da1bc930-6e90-497d-ac72-7e61ef9ed15e service nova] Creating event network-changed:90500653-99cd-4737-b71c-792e2ce9a238 for instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e on hv-cinder-81914 Jul 11 14:20:25.077376 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-0f1a1804-e006-4f99-88d9-d549f981c066 req-da1bc930-6e90-497d-ac72-7e61ef9ed15e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041066 Jul 11 14:20:25.078671 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 348/709] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:20:25.087477 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c65ab60-7011-4eb1-a331-d4d56d20b69d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:25.097468 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c65ab60-7011-4eb1-a331-d4d56d20b69d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:25.099053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c65ab60-7011-4eb1-a331-d4d56d20b69d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:25.100895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0c65ab60-7011-4eb1-a331-d4d56d20b69d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1738 microversion: 2.20 time: 0.278894 Jul 11 14:20:25.102003 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 362/710] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:24 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:25.633097 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-b52b531a-8b27-45ce-bc11-0e5776575221 req-20cfecc5-2f91-4457-b418-2d81b603809d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c32b876-b642-4e8f-b446-3381d1f545f0", "name": "network-vif-plugged", "status": "completed", "tag": "b94eb482-2115-40ae-8818-8ffac7eba877"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:20:25.655292 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-b52b531a-8b27-45ce-bc11-0e5776575221 req-20cfecc5-2f91-4457-b418-2d81b603809d service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:25.656086 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-b52b531a-8b27-45ce-bc11-0e5776575221 req-20cfecc5-2f91-4457-b418-2d81b603809d service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:25.676838 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:25.679681 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-b52b531a-8b27-45ce-bc11-0e5776575221 req-20cfecc5-2f91-4457-b418-2d81b603809d service nova] Creating event network-vif-plugged:b94eb482-2115-40ae-8818-8ffac7eba877 for instance 5c32b876-b642-4e8f-b446-3381d1f545f0 on hv-cinder-81914 Jul 11 14:20:25.693885 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-b52b531a-8b27-45ce-bc11-0e5776575221 req-20cfecc5-2f91-4457-b418-2d81b603809d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065304 Jul 11 14:20:25.705971 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 349/711] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:20:26.129924 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-46e7680f-74b7-4105-93c3-82d1a4982656 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:26.131607 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-46e7680f-74b7-4105-93c3-82d1a4982656 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:26.143258 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46e7680f-74b7-4105-93c3-82d1a4982656 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:26.144172 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46e7680f-74b7-4105-93c3-82d1a4982656 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:26.145271 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46e7680f-74b7-4105-93c3-82d1a4982656 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:26.146540 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46e7680f-74b7-4105-93c3-82d1a4982656 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:26.337007 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-46e7680f-74b7-4105-93c3-82d1a4982656 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:26.346871 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-46e7680f-74b7-4105-93c3-82d1a4982656 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:26.348743 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-46e7680f-74b7-4105-93c3-82d1a4982656 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:26.350270 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-46e7680f-74b7-4105-93c3-82d1a4982656 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1738 microversion: 2.20 time: 0.224217 Jul 11 14:20:26.351218 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 363/712] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:26 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:27.370891 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-92f5f4c8-1d42-481e-9ec4-c4357c56f39a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:27.372366 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-92f5f4c8-1d42-481e-9ec4-c4357c56f39a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:27.379489 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-92f5f4c8-1d42-481e-9ec4-c4357c56f39a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:27.380050 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-92f5f4c8-1d42-481e-9ec4-c4357c56f39a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:27.381011 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-92f5f4c8-1d42-481e-9ec4-c4357c56f39a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:27.381563 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-92f5f4c8-1d42-481e-9ec4-c4357c56f39a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:27.543236 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-92f5f4c8-1d42-481e-9ec4-c4357c56f39a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:27.551693 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-92f5f4c8-1d42-481e-9ec4-c4357c56f39a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:27.553217 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-92f5f4c8-1d42-481e-9ec4-c4357c56f39a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:27.554417 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-92f5f4c8-1d42-481e-9ec4-c4357c56f39a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1738 microversion: 2.20 time: 0.189248 Jul 11 14:20:27.554986 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 350/713] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:27 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:28.573497 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d1b38709-f472-440d-9462-5e349a826480 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:28.574435 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d1b38709-f472-440d-9462-5e349a826480 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:28.576773 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=42 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:28.582496 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d1b38709-f472-440d-9462-5e349a826480 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:28.583439 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d1b38709-f472-440d-9462-5e349a826480 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:28.584321 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d1b38709-f472-440d-9462-5e349a826480 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:28.584908 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d1b38709-f472-440d-9462-5e349a826480 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:28.758115 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d1b38709-f472-440d-9462-5e349a826480 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:28.760849 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:28.769083 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d1b38709-f472-440d-9462-5e349a826480 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:28.770801 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d1b38709-f472-440d-9462-5e349a826480 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:28.772236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d1b38709-f472-440d-9462-5e349a826480 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1738 microversion: 2.20 time: 0.203203 Jul 11 14:20:28.772919 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 364/714] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:28 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:29.792095 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2d791cc7-ca2e-4137-af7c-edc925ff11d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:29.793410 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2d791cc7-ca2e-4137-af7c-edc925ff11d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:29.802338 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2d791cc7-ca2e-4137-af7c-edc925ff11d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:29.802795 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2d791cc7-ca2e-4137-af7c-edc925ff11d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:29.803613 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2d791cc7-ca2e-4137-af7c-edc925ff11d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:29.804276 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2d791cc7-ca2e-4137-af7c-edc925ff11d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:29.964672 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2d791cc7-ca2e-4137-af7c-edc925ff11d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:29.973479 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2d791cc7-ca2e-4137-af7c-edc925ff11d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:29.975085 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2d791cc7-ca2e-4137-af7c-edc925ff11d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:29.976310 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2d791cc7-ca2e-4137-af7c-edc925ff11d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1738 microversion: 2.20 time: 0.188784 Jul 11 14:20:29.976892 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 351/715] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:29 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:30.999411 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-07b09f37-91f7-4fc4-8a10-79f09569e7d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:31.000448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-07b09f37-91f7-4fc4-8a10-79f09569e7d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:31.021263 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07b09f37-91f7-4fc4-8a10-79f09569e7d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:31.021721 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07b09f37-91f7-4fc4-8a10-79f09569e7d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:31.022541 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07b09f37-91f7-4fc4-8a10-79f09569e7d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:31.022979 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07b09f37-91f7-4fc4-8a10-79f09569e7d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:31.175979 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-07b09f37-91f7-4fc4-8a10-79f09569e7d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:31.188644 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-07b09f37-91f7-4fc4-8a10-79f09569e7d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:31.190280 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-07b09f37-91f7-4fc4-8a10-79f09569e7d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:31.191473 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-07b09f37-91f7-4fc4-8a10-79f09569e7d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1738 microversion: 2.20 time: 0.199356 Jul 11 14:20:31.192276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 365/716] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:30 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:32.210769 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3d5f2191-1420-4db9-9034-b879a9fcc2cb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:32.211572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3d5f2191-1420-4db9-9034-b879a9fcc2cb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:32.218814 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d5f2191-1420-4db9-9034-b879a9fcc2cb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:32.219508 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d5f2191-1420-4db9-9034-b879a9fcc2cb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:32.220525 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d5f2191-1420-4db9-9034-b879a9fcc2cb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:32.221176 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d5f2191-1420-4db9-9034-b879a9fcc2cb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:32.361498 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3d5f2191-1420-4db9-9034-b879a9fcc2cb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:32.370474 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3d5f2191-1420-4db9-9034-b879a9fcc2cb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:32.372001 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3d5f2191-1420-4db9-9034-b879a9fcc2cb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:32.376554 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3d5f2191-1420-4db9-9034-b879a9fcc2cb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1738 microversion: 2.20 time: 0.169816 Jul 11 14:20:32.377454 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 352/717] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:32 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:33.394975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-74623a17-fd2f-4b43-bf5d-7051e453659a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:33.395699 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-74623a17-fd2f-4b43-bf5d-7051e453659a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:33.403475 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74623a17-fd2f-4b43-bf5d-7051e453659a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:33.403927 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74623a17-fd2f-4b43-bf5d-7051e453659a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:33.404909 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74623a17-fd2f-4b43-bf5d-7051e453659a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:33.405352 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74623a17-fd2f-4b43-bf5d-7051e453659a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:33.553062 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-74623a17-fd2f-4b43-bf5d-7051e453659a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:33.561638 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-74623a17-fd2f-4b43-bf5d-7051e453659a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:33.563200 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-74623a17-fd2f-4b43-bf5d-7051e453659a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:33.564516 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-74623a17-fd2f-4b43-bf5d-7051e453659a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1738 microversion: 2.20 time: 0.173527 Jul 11 14:20:33.564917 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 366/718] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:33 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:34.584567 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-293ad86a-d886-4328-904f-30628acd26c5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:34.585448 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-293ad86a-d886-4328-904f-30628acd26c5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:34.592892 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-293ad86a-d886-4328-904f-30628acd26c5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:34.593340 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-293ad86a-d886-4328-904f-30628acd26c5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:34.594213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-293ad86a-d886-4328-904f-30628acd26c5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:34.594651 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-293ad86a-d886-4328-904f-30628acd26c5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:34.731187 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-293ad86a-d886-4328-904f-30628acd26c5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:34.739184 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-293ad86a-d886-4328-904f-30628acd26c5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:34.740796 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-293ad86a-d886-4328-904f-30628acd26c5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:34.741972 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-293ad86a-d886-4328-904f-30628acd26c5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1720 microversion: 2.20 time: 0.162634 Jul 11 14:20:34.742597 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 353/719] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:34 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:20:35.046113 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:20:35.046695 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Mon Jul 11 14:20:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:20:35.762420 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-33aac810-0c18-44ab-9e42-51679ad0f202 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:35.763057 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-33aac810-0c18-44ab-9e42-51679ad0f202 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:35.769817 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33aac810-0c18-44ab-9e42-51679ad0f202 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:35.770339 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33aac810-0c18-44ab-9e42-51679ad0f202 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:35.771175 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33aac810-0c18-44ab-9e42-51679ad0f202 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:35.771615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33aac810-0c18-44ab-9e42-51679ad0f202 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:35.901615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-33aac810-0c18-44ab-9e42-51679ad0f202 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:35.910187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-33aac810-0c18-44ab-9e42-51679ad0f202 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:35.911720 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-33aac810-0c18-44ab-9e42-51679ad0f202 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:35.912892 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-33aac810-0c18-44ab-9e42-51679ad0f202 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1720 microversion: 2.20 time: 0.155362 Jul 11 14:20:35.913456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 367/720] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:35 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:36.931404 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-38771053-cffa-4b35-a82d-297e8d40d22f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:36.932262 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-38771053-cffa-4b35-a82d-297e8d40d22f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:36.939132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38771053-cffa-4b35-a82d-297e8d40d22f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:36.939575 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38771053-cffa-4b35-a82d-297e8d40d22f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:36.940329 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38771053-cffa-4b35-a82d-297e8d40d22f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:36.940756 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38771053-cffa-4b35-a82d-297e8d40d22f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:37.070903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-38771053-cffa-4b35-a82d-297e8d40d22f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:37.082982 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-38771053-cffa-4b35-a82d-297e8d40d22f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:37.085557 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-38771053-cffa-4b35-a82d-297e8d40d22f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:37.086765 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-38771053-cffa-4b35-a82d-297e8d40d22f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1723 microversion: 2.20 time: 0.159502 Jul 11 14:20:37.087342 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 354/721] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:36 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:37.105149 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f87b4d69-37b4-4f2c-a693-8374f7c9520c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfcaedcb-e438-4785-b42e-2e9a37519749"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:20:37.106257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f87b4d69-37b4-4f2c-a693-8374f7c9520c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:37.112918 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f87b4d69-37b4-4f2c-a693-8374f7c9520c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:37.113367 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f87b4d69-37b4-4f2c-a693-8374f7c9520c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:37.114134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f87b4d69-37b4-4f2c-a693-8374f7c9520c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:37.114594 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f87b4d69-37b4-4f2c-a693-8374f7c9520c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:37.409845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f87b4d69-37b4-4f2c-a693-8374f7c9520c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "POST /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308555 Jul 11 14:20:37.410503 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 368/722] 10.222.0.66 () {62 vars in 1363 bytes} [Mon Jul 11 14:20:37 2022] POST /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/os-volume_attachments => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:20:37.511886 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-d54d2439-4120-4599-b264-5b586055a1be req-805cb325-ceda-4894-8dd1-d730f6badfb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c32b876-b642-4e8f-b446-3381d1f545f0", "name": "network-vif-unplugged", "status": "completed", "tag": "b94eb482-2115-40ae-8818-8ffac7eba877"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:20:37.521059 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-d54d2439-4120-4599-b264-5b586055a1be req-805cb325-ceda-4894-8dd1-d730f6badfb2 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:37.521516 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-d54d2439-4120-4599-b264-5b586055a1be req-805cb325-ceda-4894-8dd1-d730f6badfb2 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:37.542662 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c9be9f2f-b3d2-4849-93c8-cb95f90654aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:20:37.543268 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c9be9f2f-b3d2-4849-93c8-cb95f90654aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:37.545601 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.compute.server_external_events [req-d54d2439-4120-4599-b264-5b586055a1be req-805cb325-ceda-4894-8dd1-d730f6badfb2 service nova] Unable to find a host for instance 5c32b876-b642-4e8f-b446-3381d1f545f0. Dropping event network-vif-unplugged {{(pid=117921) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 11 14:20:37.546533 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-d54d2439-4120-4599-b264-5b586055a1be req-805cb325-ceda-4894-8dd1-d730f6badfb2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040314 Jul 11 14:20:37.547282 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 355/723] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 11 14:20:37.550794 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9be9f2f-b3d2-4849-93c8-cb95f90654aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:37.551237 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9be9f2f-b3d2-4849-93c8-cb95f90654aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:37.551904 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9be9f2f-b3d2-4849-93c8-cb95f90654aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:37.552342 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9be9f2f-b3d2-4849-93c8-cb95f90654aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:37.649154 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c9be9f2f-b3d2-4849-93c8-cb95f90654aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "POST /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/action" status: 202 len: 0 microversion: 2.20 time: 0.110558 Jul 11 14:20:37.649772 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 369/724] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Jul 11 14:20:37 2022] POST /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:20:37.657974 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-71a6d264-b70a-4bb1-bed2-7cf888f3ee37 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:37.658644 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-71a6d264-b70a-4bb1-bed2-7cf888f3ee37 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:37.664799 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-71a6d264-b70a-4bb1-bed2-7cf888f3ee37 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:37.665265 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-71a6d264-b70a-4bb1-bed2-7cf888f3ee37 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:37.666253 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-71a6d264-b70a-4bb1-bed2-7cf888f3ee37 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:37.666843 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-71a6d264-b70a-4bb1-bed2-7cf888f3ee37 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:37.811119 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-71a6d264-b70a-4bb1-bed2-7cf888f3ee37 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:37.819731 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-71a6d264-b70a-4bb1-bed2-7cf888f3ee37 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:37.821272 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-71a6d264-b70a-4bb1-bed2-7cf888f3ee37 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:37.822855 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-71a6d264-b70a-4bb1-bed2-7cf888f3ee37 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1749 microversion: 2.20 time: 0.168663 Jul 11 14:20:37.823425 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 356/725] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:37 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:38.842106 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8c740fb6-7186-48fc-b16e-912d6b7661b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:38.842687 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8c740fb6-7186-48fc-b16e-912d6b7661b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:38.849300 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c740fb6-7186-48fc-b16e-912d6b7661b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:38.849744 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c740fb6-7186-48fc-b16e-912d6b7661b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:38.850550 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c740fb6-7186-48fc-b16e-912d6b7661b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:38.850981 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c740fb6-7186-48fc-b16e-912d6b7661b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:38.987613 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8c740fb6-7186-48fc-b16e-912d6b7661b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:38.993407 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8c740fb6-7186-48fc-b16e-912d6b7661b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:38.995879 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8c740fb6-7186-48fc-b16e-912d6b7661b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:38.997067 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8c740fb6-7186-48fc-b16e-912d6b7661b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1751 microversion: 2.20 time: 0.159731 Jul 11 14:20:38.997894 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 370/726] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:38 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:40.015939 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4352286c-df59-4fb0-8768-f7cf8c591d8e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:40.016548 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4352286c-df59-4fb0-8768-f7cf8c591d8e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:40.023071 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4352286c-df59-4fb0-8768-f7cf8c591d8e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:40.023519 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4352286c-df59-4fb0-8768-f7cf8c591d8e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:40.024287 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4352286c-df59-4fb0-8768-f7cf8c591d8e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:40.025241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4352286c-df59-4fb0-8768-f7cf8c591d8e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:40.162247 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4352286c-df59-4fb0-8768-f7cf8c591d8e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:40.171261 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4352286c-df59-4fb0-8768-f7cf8c591d8e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:40.172783 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4352286c-df59-4fb0-8768-f7cf8c591d8e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:40.173971 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4352286c-df59-4fb0-8768-f7cf8c591d8e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.161926 Jul 11 14:20:40.184951 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 357/727] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:40 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:41.193115 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4ff842d7-8d62-4313-a90b-8201bb3997db tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:41.193743 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4ff842d7-8d62-4313-a90b-8201bb3997db tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:41.202027 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ff842d7-8d62-4313-a90b-8201bb3997db tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:41.202896 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ff842d7-8d62-4313-a90b-8201bb3997db tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:41.203895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ff842d7-8d62-4313-a90b-8201bb3997db tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:41.204494 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ff842d7-8d62-4313-a90b-8201bb3997db tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:41.357639 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4ff842d7-8d62-4313-a90b-8201bb3997db tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:41.369105 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4ff842d7-8d62-4313-a90b-8201bb3997db tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:41.370747 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4ff842d7-8d62-4313-a90b-8201bb3997db tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:41.371939 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4ff842d7-8d62-4313-a90b-8201bb3997db tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.183241 Jul 11 14:20:41.372764 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 371/728] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:41 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:42.390905 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d3de65a5-2721-4374-81c3-a89b8d4c0326 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:42.391739 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d3de65a5-2721-4374-81c3-a89b8d4c0326 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:42.398601 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d3de65a5-2721-4374-81c3-a89b8d4c0326 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:42.399053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d3de65a5-2721-4374-81c3-a89b8d4c0326 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:42.399838 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d3de65a5-2721-4374-81c3-a89b8d4c0326 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:42.400504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d3de65a5-2721-4374-81c3-a89b8d4c0326 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:42.546401 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d3de65a5-2721-4374-81c3-a89b8d4c0326 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:42.555528 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d3de65a5-2721-4374-81c3-a89b8d4c0326 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:42.557732 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d3de65a5-2721-4374-81c3-a89b8d4c0326 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:42.558951 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d3de65a5-2721-4374-81c3-a89b8d4c0326 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.172016 Jul 11 14:20:42.569596 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 358/729] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:42 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:43.582996 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-51edb3d0-50e7-4b8b-9575-01aaba72e4a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:43.583590 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-51edb3d0-50e7-4b8b-9575-01aaba72e4a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:43.592362 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51edb3d0-50e7-4b8b-9575-01aaba72e4a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:43.592362 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51edb3d0-50e7-4b8b-9575-01aaba72e4a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:43.592362 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51edb3d0-50e7-4b8b-9575-01aaba72e4a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:43.592726 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51edb3d0-50e7-4b8b-9575-01aaba72e4a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:43.742096 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-51edb3d0-50e7-4b8b-9575-01aaba72e4a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:43.752021 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-51edb3d0-50e7-4b8b-9575-01aaba72e4a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:43.753586 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-51edb3d0-50e7-4b8b-9575-01aaba72e4a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:43.754796 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-51edb3d0-50e7-4b8b-9575-01aaba72e4a1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.181128 Jul 11 14:20:43.765136 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 372/730] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:43 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:44.773764 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-14577717-8092-445c-bafb-42fc5b5a6808 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:44.774862 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-14577717-8092-445c-bafb-42fc5b5a6808 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:44.784834 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-14577717-8092-445c-bafb-42fc5b5a6808 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:44.785321 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-14577717-8092-445c-bafb-42fc5b5a6808 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:44.786129 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-14577717-8092-445c-bafb-42fc5b5a6808 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:44.786632 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-14577717-8092-445c-bafb-42fc5b5a6808 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:44.929273 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-14577717-8092-445c-bafb-42fc5b5a6808 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:44.939462 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-14577717-8092-445c-bafb-42fc5b5a6808 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:44.940978 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-14577717-8092-445c-bafb-42fc5b5a6808 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:44.942243 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-14577717-8092-445c-bafb-42fc5b5a6808 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.172431 Jul 11 14:20:44.947401 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 359/731] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:44 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:20:45.960518 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e181a9d0-8ace-4149-94c0-624d5c4bc9c7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:45.961157 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e181a9d0-8ace-4149-94c0-624d5c4bc9c7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:45.972696 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e181a9d0-8ace-4149-94c0-624d5c4bc9c7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:45.972696 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e181a9d0-8ace-4149-94c0-624d5c4bc9c7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:45.972696 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e181a9d0-8ace-4149-94c0-624d5c4bc9c7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:45.972696 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e181a9d0-8ace-4149-94c0-624d5c4bc9c7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:46.115950 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e181a9d0-8ace-4149-94c0-624d5c4bc9c7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:46.127999 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e181a9d0-8ace-4149-94c0-624d5c4bc9c7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:46.129549 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e181a9d0-8ace-4149-94c0-624d5c4bc9c7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:46.130801 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e181a9d0-8ace-4149-94c0-624d5c4bc9c7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.174639 Jul 11 14:20:46.131377 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 373/732] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:45 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:47.150760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-67abe264-c054-4707-bcd8-37290036bd47 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:47.152055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-67abe264-c054-4707-bcd8-37290036bd47 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:47.158792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-67abe264-c054-4707-bcd8-37290036bd47 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:47.159241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-67abe264-c054-4707-bcd8-37290036bd47 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:47.160178 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-67abe264-c054-4707-bcd8-37290036bd47 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:47.160620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-67abe264-c054-4707-bcd8-37290036bd47 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:47.315799 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-67abe264-c054-4707-bcd8-37290036bd47 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:47.325801 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-67abe264-c054-4707-bcd8-37290036bd47 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:47.327342 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-67abe264-c054-4707-bcd8-37290036bd47 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:47.328512 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-67abe264-c054-4707-bcd8-37290036bd47 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.182120 Jul 11 14:20:47.329080 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 360/733] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:47 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:48.348466 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9ad95e26-40a5-46fe-90c1-f2902579a9e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:48.349133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9ad95e26-40a5-46fe-90c1-f2902579a9e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:48.356966 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9ad95e26-40a5-46fe-90c1-f2902579a9e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:48.357643 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9ad95e26-40a5-46fe-90c1-f2902579a9e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:48.358360 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9ad95e26-40a5-46fe-90c1-f2902579a9e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:48.358802 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9ad95e26-40a5-46fe-90c1-f2902579a9e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:48.501698 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9ad95e26-40a5-46fe-90c1-f2902579a9e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:48.510890 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9ad95e26-40a5-46fe-90c1-f2902579a9e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:48.512507 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9ad95e26-40a5-46fe-90c1-f2902579a9e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:48.513771 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9ad95e26-40a5-46fe-90c1-f2902579a9e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.169749 Jul 11 14:20:48.514467 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 374/734] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:48 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:49.532799 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ca051e5e-4712-4ff0-8739-12145673f424 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:49.533417 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ca051e5e-4712-4ff0-8739-12145673f424 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:49.539984 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ca051e5e-4712-4ff0-8739-12145673f424 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:49.540428 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ca051e5e-4712-4ff0-8739-12145673f424 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:49.541185 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ca051e5e-4712-4ff0-8739-12145673f424 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:49.541618 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ca051e5e-4712-4ff0-8739-12145673f424 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:49.684385 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ca051e5e-4712-4ff0-8739-12145673f424 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:49.692831 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ca051e5e-4712-4ff0-8739-12145673f424 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:49.694375 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ca051e5e-4712-4ff0-8739-12145673f424 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:49.695537 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ca051e5e-4712-4ff0-8739-12145673f424 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.166643 Jul 11 14:20:49.696658 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 361/735] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:49 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:50.714428 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7359fc90-56d9-4d7d-a287-7adc2c8332b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:50.715044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7359fc90-56d9-4d7d-a287-7adc2c8332b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:50.721529 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7359fc90-56d9-4d7d-a287-7adc2c8332b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:50.721983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7359fc90-56d9-4d7d-a287-7adc2c8332b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:50.722800 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7359fc90-56d9-4d7d-a287-7adc2c8332b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:50.723241 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7359fc90-56d9-4d7d-a287-7adc2c8332b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:50.857041 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7359fc90-56d9-4d7d-a287-7adc2c8332b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:50.866239 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7359fc90-56d9-4d7d-a287-7adc2c8332b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:50.867921 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7359fc90-56d9-4d7d-a287-7adc2c8332b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:50.869402 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7359fc90-56d9-4d7d-a287-7adc2c8332b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.159456 Jul 11 14:20:50.870000 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 375/736] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:50 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:51.638782 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1e0a12c6-2576-4995-94cc-0b117c34d37c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:51.639432 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1e0a12c6-2576-4995-94cc-0b117c34d37c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:51.640890 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-0b4d5ff8-0c20-447f-bdfa-d1510c776138 req-240665b1-8f7e-45bd-87e7-67e3b0145c1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374e3321-9408-4c7b-b2c3-8be5d7ed6561", "tag": "6d373871-6631-4afb-9527-c160464851a2"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:20:51.645821 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e0a12c6-2576-4995-94cc-0b117c34d37c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:51.646303 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e0a12c6-2576-4995-94cc-0b117c34d37c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:51.647067 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e0a12c6-2576-4995-94cc-0b117c34d37c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:51.647573 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e0a12c6-2576-4995-94cc-0b117c34d37c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:51.650779 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0b4d5ff8-0c20-447f-bdfa-d1510c776138 req-240665b1-8f7e-45bd-87e7-67e3b0145c1e service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:51.651206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0b4d5ff8-0c20-447f-bdfa-d1510c776138 req-240665b1-8f7e-45bd-87e7-67e3b0145c1e service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:51.663080 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-0b4d5ff8-0c20-447f-bdfa-d1510c776138 req-240665b1-8f7e-45bd-87e7-67e3b0145c1e service nova] Creating event network-changed:6d373871-6631-4afb-9527-c160464851a2 for instance 374e3321-9408-4c7b-b2c3-8be5d7ed6561 on hv-cinder-81914 Jul 11 14:20:51.668819 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-0b4d5ff8-0c20-447f-bdfa-d1510c776138 req-240665b1-8f7e-45bd-87e7-67e3b0145c1e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031366 Jul 11 14:20:51.669466 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 376/737] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:20:51.675797 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1e0a12c6-2576-4995-94cc-0b117c34d37c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:20:51.763207 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1e0a12c6-2576-4995-94cc-0b117c34d37c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "DELETE /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 204 len: 0 microversion: 2.1 time: 0.128994 Jul 11 14:20:51.763941 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 362/738] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:20:51 2022] DELETE /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:20:51.774106 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cdba9926-f955-4e39-908b-48b89ba3bfcb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:51.775217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cdba9926-f955-4e39-908b-48b89ba3bfcb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:51.781986 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cdba9926-f955-4e39-908b-48b89ba3bfcb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:51.782734 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cdba9926-f955-4e39-908b-48b89ba3bfcb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:51.783519 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cdba9926-f955-4e39-908b-48b89ba3bfcb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:51.783954 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cdba9926-f955-4e39-908b-48b89ba3bfcb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:51.889239 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-33b0b681-ae14-473e-97d4-49fc7599f338 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:51.890359 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-33b0b681-ae14-473e-97d4-49fc7599f338 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:51.897047 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-33b0b681-ae14-473e-97d4-49fc7599f338 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:51.897463 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-33b0b681-ae14-473e-97d4-49fc7599f338 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:51.898388 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-33b0b681-ae14-473e-97d4-49fc7599f338 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:51.899197 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-33b0b681-ae14-473e-97d4-49fc7599f338 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:51.919737 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cdba9926-f955-4e39-908b-48b89ba3bfcb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:51.927872 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cdba9926-f955-4e39-908b-48b89ba3bfcb tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1567 microversion: 2.1 time: 0.159325 Jul 11 14:20:51.928459 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 377/739] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:51 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:20:52.042187 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-33b0b681-ae14-473e-97d4-49fc7599f338 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:52.050629 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-33b0b681-ae14-473e-97d4-49fc7599f338 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:52.052170 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-33b0b681-ae14-473e-97d4-49fc7599f338 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:52.053538 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-33b0b681-ae14-473e-97d4-49fc7599f338 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.168641 Jul 11 14:20:52.054107 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 363/740] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:51 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:20:52.950501 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8ffe4b1a-dedc-43e9-9b41-b12b6c154105 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:52.951057 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8ffe4b1a-dedc-43e9-9b41-b12b6c154105 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:52.959004 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ffe4b1a-dedc-43e9-9b41-b12b6c154105 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:52.959452 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ffe4b1a-dedc-43e9-9b41-b12b6c154105 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:52.960305 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ffe4b1a-dedc-43e9-9b41-b12b6c154105 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:52.960742 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ffe4b1a-dedc-43e9-9b41-b12b6c154105 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:52.984691 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:53.071688 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e947755f-fb24-4251-9657-7660b6dad05b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:53.072286 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e947755f-fb24-4251-9657-7660b6dad05b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:53.074515 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:53.080688 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e947755f-fb24-4251-9657-7660b6dad05b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:53.081135 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e947755f-fb24-4251-9657-7660b6dad05b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:53.081910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e947755f-fb24-4251-9657-7660b6dad05b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:53.082382 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e947755f-fb24-4251-9657-7660b6dad05b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:53.137427 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8ffe4b1a-dedc-43e9-9b41-b12b6c154105 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:53.145184 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8ffe4b1a-dedc-43e9-9b41-b12b6c154105 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1567 microversion: 2.1 time: 0.200160 Jul 11 14:20:53.145962 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 378/741] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:52 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:20:53.217949 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e947755f-fb24-4251-9657-7660b6dad05b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:53.226679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e947755f-fb24-4251-9657-7660b6dad05b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:53.228846 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e947755f-fb24-4251-9657-7660b6dad05b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:53.230017 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e947755f-fb24-4251-9657-7660b6dad05b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.162262 Jul 11 14:20:53.230608 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 364/742] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:53 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:20:54.163009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b2c59dae-b7e1-4fac-8afe-b555bdac29f3 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:54.163791 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b2c59dae-b7e1-4fac-8afe-b555bdac29f3 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:54.170805 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2c59dae-b7e1-4fac-8afe-b555bdac29f3 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:54.171258 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2c59dae-b7e1-4fac-8afe-b555bdac29f3 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:54.172043 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2c59dae-b7e1-4fac-8afe-b555bdac29f3 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:54.172479 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2c59dae-b7e1-4fac-8afe-b555bdac29f3 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:54.248362 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0ae99988-e8e3-4d94-b8d8-9faa79b8d70b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:54.249112 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0ae99988-e8e3-4d94-b8d8-9faa79b8d70b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:54.255715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0ae99988-e8e3-4d94-b8d8-9faa79b8d70b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:54.256354 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0ae99988-e8e3-4d94-b8d8-9faa79b8d70b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:54.257145 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0ae99988-e8e3-4d94-b8d8-9faa79b8d70b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:54.257582 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0ae99988-e8e3-4d94-b8d8-9faa79b8d70b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:54.273469 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:54.401562 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0ae99988-e8e3-4d94-b8d8-9faa79b8d70b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:54.410391 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0ae99988-e8e3-4d94-b8d8-9faa79b8d70b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:54.411921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0ae99988-e8e3-4d94-b8d8-9faa79b8d70b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:54.413096 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0ae99988-e8e3-4d94-b8d8-9faa79b8d70b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.169070 Jul 11 14:20:54.413675 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 365/743] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:54 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:20:54.452525 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-5d9a6ee0-c78b-4648-a4d7-60af346f5496 req-97ad914d-ad86-40d0-9ab6-bfdfe37154ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374e3321-9408-4c7b-b2c3-8be5d7ed6561", "name": "network-vif-deleted", "tag": "6d373871-6631-4afb-9527-c160464851a2"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:20:54.454311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b2c59dae-b7e1-4fac-8afe-b555bdac29f3 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:54.462310 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-5d9a6ee0-c78b-4648-a4d7-60af346f5496 req-97ad914d-ad86-40d0-9ab6-bfdfe37154ff service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:54.462761 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-5d9a6ee0-c78b-4648-a4d7-60af346f5496 req-97ad914d-ad86-40d0-9ab6-bfdfe37154ff service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:54.464527 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b2c59dae-b7e1-4fac-8afe-b555bdac29f3 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1449 microversion: 2.1 time: 0.305530 Jul 11 14:20:54.465119 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 379/744] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:54 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1449 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:20:54.475008 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-5d9a6ee0-c78b-4648-a4d7-60af346f5496 req-97ad914d-ad86-40d0-9ab6-bfdfe37154ff service nova] Creating event network-vif-deleted:6d373871-6631-4afb-9527-c160464851a2 for instance 374e3321-9408-4c7b-b2c3-8be5d7ed6561 on hv-cinder-81914 Jul 11 14:20:54.481290 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-5d9a6ee0-c78b-4648-a4d7-60af346f5496 req-97ad914d-ad86-40d0-9ab6-bfdfe37154ff service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032343 Jul 11 14:20:54.482248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 366/745] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:20:55.432661 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-38a1489f-61ed-4171-9d54-18c7fec91bf4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:55.433317 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-38a1489f-61ed-4171-9d54-18c7fec91bf4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:55.439769 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38a1489f-61ed-4171-9d54-18c7fec91bf4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:55.440209 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38a1489f-61ed-4171-9d54-18c7fec91bf4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:55.440966 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38a1489f-61ed-4171-9d54-18c7fec91bf4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:55.441392 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38a1489f-61ed-4171-9d54-18c7fec91bf4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:55.482417 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7ce63b45-f864-4623-8220-0ffff48a3a7c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:55.483128 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7ce63b45-f864-4623-8220-0ffff48a3a7c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:55.490887 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ce63b45-f864-4623-8220-0ffff48a3a7c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:55.490887 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ce63b45-f864-4623-8220-0ffff48a3a7c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:55.491502 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ce63b45-f864-4623-8220-0ffff48a3a7c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:55.491846 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ce63b45-f864-4623-8220-0ffff48a3a7c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:55.566853 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7ce63b45-f864-4623-8220-0ffff48a3a7c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8455bd8a1dd841c6bac62b553f06e683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6666e112684b9ea973be1c5833b0cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:55.576382 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7ce63b45-f864-4623-8220-0ffff48a3a7c tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 200 len: 1219 microversion: 2.1 time: 0.097866 Jul 11 14:20:55.576691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 367/746] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:55 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:20:55.587236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-38a1489f-61ed-4171-9d54-18c7fec91bf4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:55.596176 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-38a1489f-61ed-4171-9d54-18c7fec91bf4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:55.597738 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-38a1489f-61ed-4171-9d54-18c7fec91bf4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:55.598989 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-38a1489f-61ed-4171-9d54-18c7fec91bf4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.171238 Jul 11 14:20:55.599562 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 380/747] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:55 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:56.595101 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-34536b3f-ec26-443b-9f9d-b99536d56028 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:56.595655 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-34536b3f-ec26-443b-9f9d-b99536d56028 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] [instance: 374e3321-9408-4c7b-b2c3-8be5d7ed6561] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:56.603349 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34536b3f-ec26-443b-9f9d-b99536d56028 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:56.604444 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34536b3f-ec26-443b-9f9d-b99536d56028 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:56.604605 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34536b3f-ec26-443b-9f9d-b99536d56028 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:56.605006 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34536b3f-ec26-443b-9f9d-b99536d56028 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:56.622670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d05f5099-0164-47f0-86a1-56bbb2ee4c02 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:56.623362 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-34536b3f-ec26-443b-9f9d-b99536d56028 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] HTTP exception thrown: Instance 374e3321-9408-4c7b-b2c3-8be5d7ed6561 could not be found. Jul 11 14:20:56.623738 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d05f5099-0164-47f0-86a1-56bbb2ee4c02 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-34536b3f-ec26-443b-9f9d-b99536d56028 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Request method failure captured: Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 HTTP/1.1 Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDB_p7mx4leFpCwnLPbcVpEVAgt1VvI11yfTaIA6qOFGO8I4xlHOWShC5wDubQFV0m5v_A-FZEyv7b5v_Dtsw7ceLtCLQTftz-aJgZ-tpLC9UlcPlAVTQeQQxeJgAj3c6Ll_kHRVqfUmlv3JGp6TOnE5na4AFUgpebay-f84HEDHxgE Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 5c6666e112684b9ea973be1c5833b0cb Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-TestShelveInstance-1754967809 Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:20:56.625049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:20:56.626623 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5c6666e112684b9ea973be1c5833b0cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5c6666e112684b9ea973be1c5833b0cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c6666e112684b9ea973be1c5833b0cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c6666e112684b9ea973be1c5833b0cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:20:56.626623 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-TestShelveInstance-1754967809 Jul 11 14:20:56.626623 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 5c6666e112684b9ea973be1c5833b0cb Jul 11 14:20:56.626623 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-TestShelveInstance-1754967809 Jul 11 14:20:56.626623 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-TestShelveInstance-1754967809-project Jul 11 14:20:56.626623 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:20:56.626623 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:20:56.626623 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 8455bd8a1dd841c6bac62b553f06e683 Jul 11 14:20:56.626623 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-TestShelveInstance-1754967809-project Jul 11 14:20:56.626623 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:20:56.626623 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance 374e3321-9408-4c7b-b2c3-8be5d7ed6561 could not be found. Jul 11 14:20:56.626623 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': '374e3321-9408-4c7b-b2c3-8be5d7ed6561'} Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 374e3321-9408-4c7b-b2c3-8be5d7ed6561 could not be found. Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:20:56.627760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:20:56.629504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:20:56.629504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:20:56.629504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:20:56.629504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:20:56.629504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:20:56.629504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:20:56.629504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:20:56.629504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 374e3321-9408-4c7b-b2c3-8be5d7ed6561 could not be found. Jul 11 14:20:56.629504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:20:56.629504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:20:56.629504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:20:56.629504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:20:56.629504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:20:56.629504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:20:56.629504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:20:56.629504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:20:56.629504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 374e3321-9408-4c7b-b2c3-8be5d7ed6561 could not be found. Jul 11 14:20:56.629504 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:20:56.631083 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-34536b3f-ec26-443b-9f9d-b99536d56028 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Returning 404 to user: Instance 374e3321-9408-4c7b-b2c3-8be5d7ed6561 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:20:56.631083 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-34536b3f-ec26-443b-9f9d-b99536d56028 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561" status: 404 len: 111 microversion: 2.1 time: 0.036539 Jul 11 14:20:56.631083 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 368/748] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:56 2022] GET /compute/v2.1/servers/374e3321-9408-4c7b-b2c3-8be5d7ed6561 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:20:56.632733 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d05f5099-0164-47f0-86a1-56bbb2ee4c02 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:56.633818 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d05f5099-0164-47f0-86a1-56bbb2ee4c02 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:56.634694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d05f5099-0164-47f0-86a1-56bbb2ee4c02 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:56.635182 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d05f5099-0164-47f0-86a1-56bbb2ee4c02 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:56.797111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d05f5099-0164-47f0-86a1-56bbb2ee4c02 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:56.807485 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d05f5099-0164-47f0-86a1-56bbb2ee4c02 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:56.809011 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d05f5099-0164-47f0-86a1-56bbb2ee4c02 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:56.810285 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d05f5099-0164-47f0-86a1-56bbb2ee4c02 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.191903 Jul 11 14:20:56.810875 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 381/749] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:56 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:56.827410 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b6d9e0f8-ed06-4e1f-bfaa-014991512f00 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] Calling method '.version_select at 0x7fc976a89790>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:56.848637 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b6d9e0f8-ed06-4e1f-bfaa-014991512f00 tempest-TestShelveInstance-1754967809 tempest-TestShelveInstance-1754967809-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1954347746" status: 202 len: 0 microversion: 2.1 time: 0.024824 Jul 11 14:20:56.849822 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 369/750] 10.222.0.66 () {58 vars in 1253 bytes} [Mon Jul 11 14:20:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1954347746 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:20:57.829124 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dbffc97b-08ad-4655-92ef-1458bb248bb0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:57.829768 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dbffc97b-08ad-4655-92ef-1458bb248bb0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:57.839901 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dbffc97b-08ad-4655-92ef-1458bb248bb0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:57.840633 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dbffc97b-08ad-4655-92ef-1458bb248bb0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:57.841986 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dbffc97b-08ad-4655-92ef-1458bb248bb0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:57.842620 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dbffc97b-08ad-4655-92ef-1458bb248bb0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:58.084966 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dbffc97b-08ad-4655-92ef-1458bb248bb0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:58.094514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dbffc97b-08ad-4655-92ef-1458bb248bb0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:58.096613 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dbffc97b-08ad-4655-92ef-1458bb248bb0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:58.098118 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dbffc97b-08ad-4655-92ef-1458bb248bb0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.273063 Jul 11 14:20:58.098828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 382/751] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:57 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:59.117571 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-27d5eb10-160a-4e39-ba4e-6e5bfe287d4a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:59.118209 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-27d5eb10-160a-4e39-ba4e-6e5bfe287d4a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:59.125540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27d5eb10-160a-4e39-ba4e-6e5bfe287d4a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:59.125991 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27d5eb10-160a-4e39-ba4e-6e5bfe287d4a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:59.126794 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27d5eb10-160a-4e39-ba4e-6e5bfe287d4a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:59.127231 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27d5eb10-160a-4e39-ba4e-6e5bfe287d4a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:59.311561 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-27d5eb10-160a-4e39-ba4e-6e5bfe287d4a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:59.322617 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-27d5eb10-160a-4e39-ba4e-6e5bfe287d4a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:59.324637 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-27d5eb10-160a-4e39-ba4e-6e5bfe287d4a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:59.326055 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-27d5eb10-160a-4e39-ba4e-6e5bfe287d4a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.213171 Jul 11 14:20:59.337594 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 370/752] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:20:59 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:20:59.890610 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-4fe08458-d449-4e10-b8a5-4efb770ccce9 req-5e771cd3-33ff-4d69-961b-40ec36a0831f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c32b876-b642-4e8f-b446-3381d1f545f0", "name": "network-vif-plugged", "status": "completed", "tag": "b94eb482-2115-40ae-8818-8ffac7eba877"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:20:59.903487 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=40 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:59.907644 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-4fe08458-d449-4e10-b8a5-4efb770ccce9 req-5e771cd3-33ff-4d69-961b-40ec36a0831f service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:59.908273 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-4fe08458-d449-4e10-b8a5-4efb770ccce9 req-5e771cd3-33ff-4d69-961b-40ec36a0831f service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:59.921250 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-4fe08458-d449-4e10-b8a5-4efb770ccce9 req-5e771cd3-33ff-4d69-961b-40ec36a0831f service nova] Creating event network-vif-plugged:b94eb482-2115-40ae-8818-8ffac7eba877 for instance 5c32b876-b642-4e8f-b446-3381d1f545f0 on hv-cinder-81914 Jul 11 14:20:59.927289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-4fe08458-d449-4e10-b8a5-4efb770ccce9 req-5e771cd3-33ff-4d69-961b-40ec36a0831f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040235 Jul 11 14:20:59.928456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 383/753] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:21:00.344976 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-eb975ff5-50f6-4128-913c-10510fb41913 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:00.346573 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-eb975ff5-50f6-4128-913c-10510fb41913 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:00.356456 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb975ff5-50f6-4128-913c-10510fb41913 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:00.357255 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb975ff5-50f6-4128-913c-10510fb41913 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:00.358081 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb975ff5-50f6-4128-913c-10510fb41913 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:00.358557 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb975ff5-50f6-4128-913c-10510fb41913 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:00.606130 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-eb975ff5-50f6-4128-913c-10510fb41913 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:00.614928 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-eb975ff5-50f6-4128-913c-10510fb41913 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:00.616451 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-eb975ff5-50f6-4128-913c-10510fb41913 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:00.618450 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-eb975ff5-50f6-4128-913c-10510fb41913 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.277283 Jul 11 14:21:00.619199 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 371/754] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:21:00 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:21:01.640698 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-67cb907b-d912-48a2-a020-7ab948adb949 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:01.641853 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-67cb907b-d912-48a2-a020-7ab948adb949 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:01.651762 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67cb907b-d912-48a2-a020-7ab948adb949 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:01.652219 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67cb907b-d912-48a2-a020-7ab948adb949 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:01.653031 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67cb907b-d912-48a2-a020-7ab948adb949 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:01.653470 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67cb907b-d912-48a2-a020-7ab948adb949 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:01.808503 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-67cb907b-d912-48a2-a020-7ab948adb949 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:01.821984 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-67cb907b-d912-48a2-a020-7ab948adb949 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:01.823533 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-67cb907b-d912-48a2-a020-7ab948adb949 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:01.824718 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-67cb907b-d912-48a2-a020-7ab948adb949 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.190818 Jul 11 14:21:01.825290 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 384/755] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:21:01 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:21:02.846141 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4fb6fb6c-df57-428e-88b1-6cebf3cf095a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:02.846775 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4fb6fb6c-df57-428e-88b1-6cebf3cf095a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:02.854315 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4fb6fb6c-df57-428e-88b1-6cebf3cf095a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:02.854920 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4fb6fb6c-df57-428e-88b1-6cebf3cf095a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:02.855814 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4fb6fb6c-df57-428e-88b1-6cebf3cf095a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:02.856376 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4fb6fb6c-df57-428e-88b1-6cebf3cf095a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:03.041409 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4fb6fb6c-df57-428e-88b1-6cebf3cf095a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:03.050712 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4fb6fb6c-df57-428e-88b1-6cebf3cf095a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:03.052213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4fb6fb6c-df57-428e-88b1-6cebf3cf095a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:03.053798 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4fb6fb6c-df57-428e-88b1-6cebf3cf095a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1807 microversion: 2.20 time: 0.213999 Jul 11 14:21:03.054053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 372/756] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:21:02 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:21:04.072674 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-34d18632-0f33-42e1-b40a-a97e2ea9a40f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:04.073301 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-34d18632-0f33-42e1-b40a-a97e2ea9a40f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:04.079747 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34d18632-0f33-42e1-b40a-a97e2ea9a40f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:04.080203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34d18632-0f33-42e1-b40a-a97e2ea9a40f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:04.080986 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34d18632-0f33-42e1-b40a-a97e2ea9a40f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:04.081452 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34d18632-0f33-42e1-b40a-a97e2ea9a40f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:04.220756 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-34d18632-0f33-42e1-b40a-a97e2ea9a40f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:04.229830 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-34d18632-0f33-42e1-b40a-a97e2ea9a40f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:04.232713 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-34d18632-0f33-42e1-b40a-a97e2ea9a40f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:04.234883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-34d18632-0f33-42e1-b40a-a97e2ea9a40f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1794 microversion: 2.20 time: 0.166745 Jul 11 14:21:04.235831 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 385/757] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:21:04 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1794 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:21:08.873263 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-060cb374-d888-4415-a4c2-20d3bbd81e3e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:08.873840 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-060cb374-d888-4415-a4c2-20d3bbd81e3e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:08.880512 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-060cb374-d888-4415-a4c2-20d3bbd81e3e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:08.880953 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-060cb374-d888-4415-a4c2-20d3bbd81e3e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:08.881715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-060cb374-d888-4415-a4c2-20d3bbd81e3e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:08.882143 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-060cb374-d888-4415-a4c2-20d3bbd81e3e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:08.905268 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-060cb374-d888-4415-a4c2-20d3bbd81e3e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e/ips" status: 200 len: 151 microversion: 2.1 time: 0.036171 Jul 11 14:21:08.905841 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 373/758] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 11 14:21:08 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:21:10.253634 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3a97c044-9304-4bac-86f9-2ea4f00cd922 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d716f2f3-e89d-41f1-8bb0-d29f56e96ba5"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:21:10.254745 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3a97c044-9304-4bac-86f9-2ea4f00cd922 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:10.261608 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a97c044-9304-4bac-86f9-2ea4f00cd922 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:10.262059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a97c044-9304-4bac-86f9-2ea4f00cd922 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:10.262880 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a97c044-9304-4bac-86f9-2ea4f00cd922 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:10.263313 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a97c044-9304-4bac-86f9-2ea4f00cd922 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:10.517746 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3a97c044-9304-4bac-86f9-2ea4f00cd922 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "POST /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267850 Jul 11 14:21:10.518470 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 386/759] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 11 14:21:10 2022] POST /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:21:18.021671 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a2e57e7e-4e67-4d7e-b0fd-6c0596aced3b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Action: 'create', calling method: .version_select at 0x7fc976bd6b80>, body: {"keypair": {"name": "tempest-keypair-93337798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENN7dGBiIPAMjVPJbgSykYc2GX/3GmRKgkIZ000uam0xAHpNknPP+2aN/TSz2B/bGPe1dy51v8NdMVVLs6L0o+0zDU7J/++GOqRuNut2jTU5qSIiBVuyDH/AqRMmXK8Mw=="}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:21:18.036282 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-a2e57e7e-4e67-4d7e-b0fd-6c0596aced3b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Getting quotas for project 30c5e99c9761441fbad367a0bb8e1e66. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:21:18.040752 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-a2e57e7e-4e67-4d7e-b0fd-6c0596aced3b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Getting quotas for user 5bbea49c1a55481c9995f04f2e9b8618 and project 30c5e99c9761441fbad367a0bb8e1e66. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:21:18.063006 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a2e57e7e-4e67-4d7e-b0fd-6c0596aced3b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.045130 Jul 11 14:21:18.063615 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 374/760] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 11 14:21:18 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:21:19.617924 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-52b6d9f4-a35c-4a1b-9d4d-acb58b24c5dd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-522842232", "imageRef": "67874ac7-fac8-4d6d-9cd1-9091ecb957b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "082c1f0c-e3fc-4cfb-9f28-88c9d2f15bb4"}], "security_groups": [{"name": "tempest-securitygroup--1886139596"}], "key_name": "tempest-keypair-93337798", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:21:19.722274 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-52b6d9f4-a35c-4a1b-9d4d-acb58b24c5dd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] validate_networks() for [('082c1f0c-e3fc-4cfb-9f28-88c9d2f15bb4', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:21:20.104416 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-52b6d9f4-a35c-4a1b-9d4d-acb58b24c5dd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:21:20.104838 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-52b6d9f4-a35c-4a1b-9d4d-acb58b24c5dd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:21:20.105347 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-52b6d9f4-a35c-4a1b-9d4d-acb58b24c5dd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:21:20.105758 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-52b6d9f4-a35c-4a1b-9d4d-acb58b24c5dd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:21:20.106190 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-52b6d9f4-a35c-4a1b-9d4d-acb58b24c5dd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:21:20.115115 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52b6d9f4-a35c-4a1b-9d4d-acb58b24c5dd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:20.115562 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52b6d9f4-a35c-4a1b-9d4d-acb58b24c5dd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:20.116361 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52b6d9f4-a35c-4a1b-9d4d-acb58b24c5dd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:20.116789 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52b6d9f4-a35c-4a1b-9d4d-acb58b24c5dd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:20.133402 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-52b6d9f4-a35c-4a1b-9d4d-acb58b24c5dd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Getting quotas for project 30c5e99c9761441fbad367a0bb8e1e66. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:21:20.137961 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-52b6d9f4-a35c-4a1b-9d4d-acb58b24c5dd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Getting quotas for user 5bbea49c1a55481c9995f04f2e9b8618 and project 30c5e99c9761441fbad367a0bb8e1e66. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:21:20.148781 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-52b6d9f4-a35c-4a1b-9d4d-acb58b24c5dd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:21:20.151882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-52b6d9f4-a35c-4a1b-9d4d-acb58b24c5dd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67874ac7-fac8-4d6d-9cd1-9091ecb957b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:21:20.202064 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-52b6d9f4-a35c-4a1b-9d4d-acb58b24c5dd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.589194 Jul 11 14:21:20.203030 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 387/761] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:21:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:21:20.216862 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=35 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:20.223562 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ade66d3e-4c4f-4b19-a15b-ba54ae36c12f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:20.224440 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ade66d3e-4c4f-4b19-a15b-ba54ae36c12f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:20.281490 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ade66d3e-4c4f-4b19-a15b-ba54ae36c12f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:20.290601 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ade66d3e-4c4f-4b19-a15b-ba54ae36c12f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 200 len: 1239 microversion: 2.1 time: 0.075018 Jul 11 14:21:20.293153 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 375/762] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:20 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 1239 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:21.311812 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bc57dbe8-b5fc-4f1c-bf41-2325f5a887e7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:21.312793 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bc57dbe8-b5fc-4f1c-bf41-2325f5a887e7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:21.320913 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc57dbe8-b5fc-4f1c-bf41-2325f5a887e7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:21.321370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc57dbe8-b5fc-4f1c-bf41-2325f5a887e7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:21.322673 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc57dbe8-b5fc-4f1c-bf41-2325f5a887e7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:21.323180 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc57dbe8-b5fc-4f1c-bf41-2325f5a887e7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:21.398951 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bc57dbe8-b5fc-4f1c-bf41-2325f5a887e7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:21.408442 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bc57dbe8-b5fc-4f1c-bf41-2325f5a887e7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 200 len: 1309 microversion: 2.1 time: 0.101481 Jul 11 14:21:21.409042 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 388/763] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:21 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:21:22.426950 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-71d49d44-505c-4e59-bb94-1332c6f31a5c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:22.427584 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-71d49d44-505c-4e59-bb94-1332c6f31a5c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:22.436259 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-71d49d44-505c-4e59-bb94-1332c6f31a5c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:22.436871 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-71d49d44-505c-4e59-bb94-1332c6f31a5c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:22.437871 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-71d49d44-505c-4e59-bb94-1332c6f31a5c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:22.438297 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-71d49d44-505c-4e59-bb94-1332c6f31a5c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:22.578459 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-71d49d44-505c-4e59-bb94-1332c6f31a5c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:22.586441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-71d49d44-505c-4e59-bb94-1332c6f31a5c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 200 len: 1365 microversion: 2.1 time: 0.163754 Jul 11 14:21:22.587909 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 376/764] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:22 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:23.213772 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-2bad01fb-0234-4ebe-989c-3c130274af39 req-bdeddea5-1a7c-4e25-8b8a-bc4454846150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "362320ea-1be9-4e52-b970-1ad8ea945ea0", "tag": "a84bc9e7-18dd-4e8c-80ff-531b1330d93e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:21:23.222965 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-2bad01fb-0234-4ebe-989c-3c130274af39 req-bdeddea5-1a7c-4e25-8b8a-bc4454846150 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:23.223602 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-2bad01fb-0234-4ebe-989c-3c130274af39 req-bdeddea5-1a7c-4e25-8b8a-bc4454846150 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:23.240367 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:23.242250 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-2bad01fb-0234-4ebe-989c-3c130274af39 req-bdeddea5-1a7c-4e25-8b8a-bc4454846150 service nova] Creating event network-changed:a84bc9e7-18dd-4e8c-80ff-531b1330d93e for instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 on hv-cinder-81914 Jul 11 14:21:23.249274 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-2bad01fb-0234-4ebe-989c-3c130274af39 req-bdeddea5-1a7c-4e25-8b8a-bc4454846150 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043783 Jul 11 14:21:23.249889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 389/765] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:21:23.605573 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-77bdb1ab-6f38-4f54-9e3c-9b40318f9129 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:23.606412 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-77bdb1ab-6f38-4f54-9e3c-9b40318f9129 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:23.608520 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:23.614428 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-77bdb1ab-6f38-4f54-9e3c-9b40318f9129 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:23.614889 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-77bdb1ab-6f38-4f54-9e3c-9b40318f9129 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:23.617665 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-77bdb1ab-6f38-4f54-9e3c-9b40318f9129 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:23.617665 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-77bdb1ab-6f38-4f54-9e3c-9b40318f9129 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:23.772950 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-77bdb1ab-6f38-4f54-9e3c-9b40318f9129 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:23.780875 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-77bdb1ab-6f38-4f54-9e3c-9b40318f9129 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 200 len: 1365 microversion: 2.1 time: 0.180129 Jul 11 14:21:23.781453 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 377/766] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:23 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:24.798909 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c156ba37-2ada-4aeb-ba81-c3d1767c634a tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:24.799601 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c156ba37-2ada-4aeb-ba81-c3d1767c634a tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:24.807189 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c156ba37-2ada-4aeb-ba81-c3d1767c634a tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:24.807725 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c156ba37-2ada-4aeb-ba81-c3d1767c634a tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:24.808487 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c156ba37-2ada-4aeb-ba81-c3d1767c634a tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:24.808915 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c156ba37-2ada-4aeb-ba81-c3d1767c634a tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:24.940640 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c156ba37-2ada-4aeb-ba81-c3d1767c634a tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:24.948463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c156ba37-2ada-4aeb-ba81-c3d1767c634a tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 200 len: 1365 microversion: 2.1 time: 0.154554 Jul 11 14:21:24.949064 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 390/767] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:24 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:21:25.965777 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c9bc5cfb-b36d-4f67-99c5-abf148e56804 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:25.966440 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c9bc5cfb-b36d-4f67-99c5-abf148e56804 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:25.972964 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c9bc5cfb-b36d-4f67-99c5-abf148e56804 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:25.973402 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c9bc5cfb-b36d-4f67-99c5-abf148e56804 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:25.974174 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c9bc5cfb-b36d-4f67-99c5-abf148e56804 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:25.974615 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c9bc5cfb-b36d-4f67-99c5-abf148e56804 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:26.108453 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c9bc5cfb-b36d-4f67-99c5-abf148e56804 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:26.115818 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c9bc5cfb-b36d-4f67-99c5-abf148e56804 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 200 len: 1365 microversion: 2.1 time: 0.154326 Jul 11 14:21:26.116388 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 378/768] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:25 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:27.134768 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c97bf48e-4b3c-452f-99c8-4c3c4f0c3ab7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:27.135339 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c97bf48e-4b3c-452f-99c8-4c3c4f0c3ab7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:27.141797 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c97bf48e-4b3c-452f-99c8-4c3c4f0c3ab7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:27.142270 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c97bf48e-4b3c-452f-99c8-4c3c4f0c3ab7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:27.143027 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c97bf48e-4b3c-452f-99c8-4c3c4f0c3ab7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:27.143470 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c97bf48e-4b3c-452f-99c8-4c3c4f0c3ab7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:27.283610 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c97bf48e-4b3c-452f-99c8-4c3c4f0c3ab7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:27.291806 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c97bf48e-4b3c-452f-99c8-4c3c4f0c3ab7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 200 len: 1365 microversion: 2.1 time: 0.160975 Jul 11 14:21:27.292384 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 391/769] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:27 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:28.308759 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f0394549-e5b5-4045-ac19-9caf83ecc366 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:28.309445 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f0394549-e5b5-4045-ac19-9caf83ecc366 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:28.315969 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0394549-e5b5-4045-ac19-9caf83ecc366 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:28.316406 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0394549-e5b5-4045-ac19-9caf83ecc366 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:28.317173 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0394549-e5b5-4045-ac19-9caf83ecc366 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:28.317604 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0394549-e5b5-4045-ac19-9caf83ecc366 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:28.452040 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f0394549-e5b5-4045-ac19-9caf83ecc366 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:28.459806 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f0394549-e5b5-4045-ac19-9caf83ecc366 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 200 len: 1365 microversion: 2.1 time: 0.154999 Jul 11 14:21:28.460397 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 379/770] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:28 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:29.477878 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b476412f-87fc-4ccb-bc05-3e4872dc0453 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:29.478526 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b476412f-87fc-4ccb-bc05-3e4872dc0453 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:29.485036 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b476412f-87fc-4ccb-bc05-3e4872dc0453 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:29.485489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b476412f-87fc-4ccb-bc05-3e4872dc0453 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:29.486294 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b476412f-87fc-4ccb-bc05-3e4872dc0453 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:29.486734 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b476412f-87fc-4ccb-bc05-3e4872dc0453 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:29.617522 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b476412f-87fc-4ccb-bc05-3e4872dc0453 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:29.626146 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b476412f-87fc-4ccb-bc05-3e4872dc0453 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 200 len: 1365 microversion: 2.1 time: 0.152419 Jul 11 14:21:29.627134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 392/771] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:29 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:30.644318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-10a9af52-4d7d-47dc-95eb-92a984001c0c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:30.644933 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-10a9af52-4d7d-47dc-95eb-92a984001c0c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:30.647368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:30.653176 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10a9af52-4d7d-47dc-95eb-92a984001c0c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:30.653628 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10a9af52-4d7d-47dc-95eb-92a984001c0c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:30.654464 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10a9af52-4d7d-47dc-95eb-92a984001c0c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:30.654901 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10a9af52-4d7d-47dc-95eb-92a984001c0c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:30.787905 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-10a9af52-4d7d-47dc-95eb-92a984001c0c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:30.795823 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-10a9af52-4d7d-47dc-95eb-92a984001c0c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 200 len: 1365 microversion: 2.1 time: 0.155795 Jul 11 14:21:30.796412 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 380/772] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:30 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:31.813068 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-00ee84f0-9ed1-402e-a9d1-a98c566f348d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:31.813677 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-00ee84f0-9ed1-402e-a9d1-a98c566f348d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:31.815625 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:31.816312 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:31.817768 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:31.825232 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00ee84f0-9ed1-402e-a9d1-a98c566f348d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:31.825612 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00ee84f0-9ed1-402e-a9d1-a98c566f348d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:31.826411 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00ee84f0-9ed1-402e-a9d1-a98c566f348d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:31.826839 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00ee84f0-9ed1-402e-a9d1-a98c566f348d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:31.861588 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-a802220c-8d23-4425-ae33-c27bec5e3245 req-386c4670-16ff-4ddb-b146-e940cfc55603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362320ea-1be9-4e52-b970-1ad8ea945ea0", "name": "network-vif-plugged", "status": "completed", "tag": "a84bc9e7-18dd-4e8c-80ff-531b1330d93e"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:21:31.871538 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-a802220c-8d23-4425-ae33-c27bec5e3245 req-386c4670-16ff-4ddb-b146-e940cfc55603 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:31.871805 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-a802220c-8d23-4425-ae33-c27bec5e3245 req-386c4670-16ff-4ddb-b146-e940cfc55603 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:31.885617 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-a802220c-8d23-4425-ae33-c27bec5e3245 req-386c4670-16ff-4ddb-b146-e940cfc55603 service nova] Creating event network-vif-plugged:a84bc9e7-18dd-4e8c-80ff-531b1330d93e for instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 on hv-cinder-81914 Jul 11 14:21:31.890973 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-a802220c-8d23-4425-ae33-c27bec5e3245 req-386c4670-16ff-4ddb-b146-e940cfc55603 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032945 Jul 11 14:21:31.891786 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 381/773] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:21:31.975140 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-00ee84f0-9ed1-402e-a9d1-a98c566f348d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:31.983788 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-00ee84f0-9ed1-402e-a9d1-a98c566f348d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 200 len: 1365 microversion: 2.1 time: 0.174597 Jul 11 14:21:31.984373 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 393/774] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:31 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:32.354658 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4dc6fccf-5705-484d-9b04-6bccc2a97d18 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2008024852", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2127391203", "security_groups": [{"name": "tempest-secgroup-smoke-144034367"}], "block_device_mapping_v2": [{"uuid": "602b468c-266a-4a29-8fd8-ecbdba87700b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61698ae3-86b6-41a7-9062-ee7a458ad7a1"}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:21:32.467841 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-4dc6fccf-5705-484d-9b04-6bccc2a97d18 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] validate_networks() for [('61698ae3-86b6-41a7-9062-ee7a458ad7a1', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:21:32.846325 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-4dc6fccf-5705-484d-9b04-6bccc2a97d18 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:21:32.846864 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-4dc6fccf-5705-484d-9b04-6bccc2a97d18 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:21:32.847298 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-4dc6fccf-5705-484d-9b04-6bccc2a97d18 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:21:32.847733 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-4dc6fccf-5705-484d-9b04-6bccc2a97d18 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:21:32.850540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-4dc6fccf-5705-484d-9b04-6bccc2a97d18 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:21:32.858815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4dc6fccf-5705-484d-9b04-6bccc2a97d18 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:32.859262 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4dc6fccf-5705-484d-9b04-6bccc2a97d18 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:32.860065 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4dc6fccf-5705-484d-9b04-6bccc2a97d18 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:32.860535 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4dc6fccf-5705-484d-9b04-6bccc2a97d18 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:32.877949 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-4dc6fccf-5705-484d-9b04-6bccc2a97d18 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Getting quotas for project 8da67a5ec9194e7bad1eb52c45a584bf. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:21:32.882220 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-4dc6fccf-5705-484d-9b04-6bccc2a97d18 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Getting quotas for user 5383a1d1bec34094a1889a86d87a88b5 and project 8da67a5ec9194e7bad1eb52c45a584bf. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:21:32.941314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4dc6fccf-5705-484d-9b04-6bccc2a97d18 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:21:32.943664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4dc6fccf-5705-484d-9b04-6bccc2a97d18 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='602b468c-266a-4a29-8fd8-ecbdba87700b',volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:21:33.000406 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-80927e43-2f02-4e55-827a-3a14e63a9237 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:33.001014 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-80927e43-2f02-4e55-827a-3a14e63a9237 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:33.007882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80927e43-2f02-4e55-827a-3a14e63a9237 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:33.008332 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80927e43-2f02-4e55-827a-3a14e63a9237 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:33.009902 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80927e43-2f02-4e55-827a-3a14e63a9237 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:33.010371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80927e43-2f02-4e55-827a-3a14e63a9237 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:33.078026 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4dc6fccf-5705-484d-9b04-6bccc2a97d18 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.728281 Jul 11 14:21:33.079024 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 382/775] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:21:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:21:33.089198 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-73ca1510-7386-49ef-bd54-cb460298b559 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:33.089819 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-73ca1510-7386-49ef-bd54-cb460298b559 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:33.147287 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-73ca1510-7386-49ef-bd54-cb460298b559 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:33.151614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-80927e43-2f02-4e55-827a-3a14e63a9237 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:33.155350 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-73ca1510-7386-49ef-bd54-cb460298b559 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1095 microversion: 2.1 time: 0.070469 Jul 11 14:21:33.156600 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 383/776] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:33 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:21:33.161655 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-80927e43-2f02-4e55-827a-3a14e63a9237 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 200 len: 1365 microversion: 2.1 time: 0.165424 Jul 11 14:21:33.162365 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 394/777] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:32 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:21:34.172783 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ed482172-38e0-4b11-936c-6fb68f138875 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:34.173378 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ed482172-38e0-4b11-936c-6fb68f138875 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:34.178361 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ae2946ed-c25d-4626-a03c-2a797e4cad6b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:34.179517 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ae2946ed-c25d-4626-a03c-2a797e4cad6b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:34.180187 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ed482172-38e0-4b11-936c-6fb68f138875 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:34.180667 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ed482172-38e0-4b11-936c-6fb68f138875 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:34.181539 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ed482172-38e0-4b11-936c-6fb68f138875 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:34.181970 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ed482172-38e0-4b11-936c-6fb68f138875 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:34.187461 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae2946ed-c25d-4626-a03c-2a797e4cad6b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:34.188115 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae2946ed-c25d-4626-a03c-2a797e4cad6b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:34.189014 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae2946ed-c25d-4626-a03c-2a797e4cad6b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:34.189714 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae2946ed-c25d-4626-a03c-2a797e4cad6b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:34.270570 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ed482172-38e0-4b11-936c-6fb68f138875 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:34.280347 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ed482172-38e0-4b11-936c-6fb68f138875 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1137 microversion: 2.1 time: 0.111248 Jul 11 14:21:34.281329 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 384/778] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:34 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1137 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:34.490011 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ae2946ed-c25d-4626-a03c-2a797e4cad6b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:34.499588 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ae2946ed-c25d-4626-a03c-2a797e4cad6b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 200 len: 1555 microversion: 2.1 time: 0.324961 Jul 11 14:21:34.500177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 395/779] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:34 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 1555 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:34.517058 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e70e8d5b-355b-4a04-b4d4-30bab675029c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:34.517631 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e70e8d5b-355b-4a04-b4d4-30bab675029c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:34.523686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e70e8d5b-355b-4a04-b4d4-30bab675029c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:34.524599 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e70e8d5b-355b-4a04-b4d4-30bab675029c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:34.525400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e70e8d5b-355b-4a04-b4d4-30bab675029c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:34.525841 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e70e8d5b-355b-4a04-b4d4-30bab675029c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:34.608526 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e70e8d5b-355b-4a04-b4d4-30bab675029c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095586 Jul 11 14:21:34.609131 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 385/780] 10.222.0.66 () {58 vars in 1274 bytes} [Mon Jul 11 14:21:34 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:21:35.298626 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-13fd0d4e-9992-458c-83ea-d90224d2d846 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:35.299242 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-13fd0d4e-9992-458c-83ea-d90224d2d846 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:35.306269 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13fd0d4e-9992-458c-83ea-d90224d2d846 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:35.306866 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13fd0d4e-9992-458c-83ea-d90224d2d846 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:35.307674 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13fd0d4e-9992-458c-83ea-d90224d2d846 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:35.308126 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13fd0d4e-9992-458c-83ea-d90224d2d846 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:35.400361 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-13fd0d4e-9992-458c-83ea-d90224d2d846 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:35.407477 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-13fd0d4e-9992-458c-83ea-d90224d2d846 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1211 microversion: 2.1 time: 0.112839 Jul 11 14:21:35.408293 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 396/781] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:35 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1211 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:36.370099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-1302d3bc-d30a-4b9c-bb43-42da55bc1e27 req-59c449ea-ef47-4123-bff8-0975c119dfd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "362320ea-1be9-4e52-b970-1ad8ea945ea0", "tag": "a84bc9e7-18dd-4e8c-80ff-531b1330d93e"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:21:36.381111 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-1302d3bc-d30a-4b9c-bb43-42da55bc1e27 req-59c449ea-ef47-4123-bff8-0975c119dfd7 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:36.381546 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-1302d3bc-d30a-4b9c-bb43-42da55bc1e27 req-59c449ea-ef47-4123-bff8-0975c119dfd7 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:36.394073 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-1302d3bc-d30a-4b9c-bb43-42da55bc1e27 req-59c449ea-ef47-4123-bff8-0975c119dfd7 service nova] Creating event network-changed:a84bc9e7-18dd-4e8c-80ff-531b1330d93e for instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 on hv-cinder-81914 Jul 11 14:21:36.400045 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-1302d3bc-d30a-4b9c-bb43-42da55bc1e27 req-59c449ea-ef47-4123-bff8-0975c119dfd7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033625 Jul 11 14:21:36.400928 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 386/782] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:21:36.427539 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c3f02871-454e-45f9-b211-58a8e15ab43e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:36.432275 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c3f02871-454e-45f9-b211-58a8e15ab43e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:36.452053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3f02871-454e-45f9-b211-58a8e15ab43e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:36.452917 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3f02871-454e-45f9-b211-58a8e15ab43e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:36.455003 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3f02871-454e-45f9-b211-58a8e15ab43e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:36.455788 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3f02871-454e-45f9-b211-58a8e15ab43e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:36.760553 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c3f02871-454e-45f9-b211-58a8e15ab43e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:36.769210 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c3f02871-454e-45f9-b211-58a8e15ab43e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1266 microversion: 2.1 time: 0.348005 Jul 11 14:21:36.779981 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 397/783] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:36 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1266 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:37.790578 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ce35e81a-30fc-4158-b1ca-a31ff25ab5b1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:37.791411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ce35e81a-30fc-4158-b1ca-a31ff25ab5b1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:37.799241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ce35e81a-30fc-4158-b1ca-a31ff25ab5b1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:37.799684 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ce35e81a-30fc-4158-b1ca-a31ff25ab5b1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:37.800795 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ce35e81a-30fc-4158-b1ca-a31ff25ab5b1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:37.801589 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ce35e81a-30fc-4158-b1ca-a31ff25ab5b1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:37.944458 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ce35e81a-30fc-4158-b1ca-a31ff25ab5b1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:37.952871 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ce35e81a-30fc-4158-b1ca-a31ff25ab5b1 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1266 microversion: 2.1 time: 0.169340 Jul 11 14:21:37.953462 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 387/784] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:37 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:38.417777 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-bd0c3d68-46f6-42bf-9c7a-50187b9206a4 req-3f418d4f-02c9-40cb-8a9c-5134f85ba80a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c823a7a9-0fb0-42b9-af86-8cf9697b9036", "tag": "6a382ee4-94ce-4073-9f34-0eea75f61a5c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:21:38.427591 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-bd0c3d68-46f6-42bf-9c7a-50187b9206a4 req-3f418d4f-02c9-40cb-8a9c-5134f85ba80a service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:38.428282 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-bd0c3d68-46f6-42bf-9c7a-50187b9206a4 req-3f418d4f-02c9-40cb-8a9c-5134f85ba80a service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:38.439821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-bd0c3d68-46f6-42bf-9c7a-50187b9206a4 req-3f418d4f-02c9-40cb-8a9c-5134f85ba80a service nova] Creating event network-changed:6a382ee4-94ce-4073-9f34-0eea75f61a5c for instance c823a7a9-0fb0-42b9-af86-8cf9697b9036 on hv-cinder-81914 Jul 11 14:21:38.445271 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-bd0c3d68-46f6-42bf-9c7a-50187b9206a4 req-3f418d4f-02c9-40cb-8a9c-5134f85ba80a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031804 Jul 11 14:21:38.446583 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 398/785] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:21:38.970683 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ad49b3b2-0b27-4408-a1d7-44525658a9b9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:38.971296 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ad49b3b2-0b27-4408-a1d7-44525658a9b9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:38.978349 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ad49b3b2-0b27-4408-a1d7-44525658a9b9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:38.978795 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ad49b3b2-0b27-4408-a1d7-44525658a9b9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:38.979573 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ad49b3b2-0b27-4408-a1d7-44525658a9b9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:38.979993 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ad49b3b2-0b27-4408-a1d7-44525658a9b9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:39.118859 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ad49b3b2-0b27-4408-a1d7-44525658a9b9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:39.126891 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ad49b3b2-0b27-4408-a1d7-44525658a9b9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1266 microversion: 2.1 time: 0.160128 Jul 11 14:21:39.127542 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 388/786] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:38 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:40.145306 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-64c218ce-51db-439e-b9c1-42d3c27217bd tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:40.146013 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-64c218ce-51db-439e-b9c1-42d3c27217bd tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:40.152789 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64c218ce-51db-439e-b9c1-42d3c27217bd tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:40.153244 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64c218ce-51db-439e-b9c1-42d3c27217bd tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:40.154019 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64c218ce-51db-439e-b9c1-42d3c27217bd tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:40.154628 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64c218ce-51db-439e-b9c1-42d3c27217bd tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:40.294884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-64c218ce-51db-439e-b9c1-42d3c27217bd tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:40.302441 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-64c218ce-51db-439e-b9c1-42d3c27217bd tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1266 microversion: 2.1 time: 0.161979 Jul 11 14:21:40.303018 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 399/787] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:40 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:41.319293 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4fe72f32-f6d9-42f6-966a-4e06ddc639bb tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:41.319903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4fe72f32-f6d9-42f6-966a-4e06ddc639bb tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:41.326634 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4fe72f32-f6d9-42f6-966a-4e06ddc639bb tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:41.327076 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4fe72f32-f6d9-42f6-966a-4e06ddc639bb tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:41.327830 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4fe72f32-f6d9-42f6-966a-4e06ddc639bb tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:41.328255 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4fe72f32-f6d9-42f6-966a-4e06ddc639bb tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:41.461910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4fe72f32-f6d9-42f6-966a-4e06ddc639bb tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:41.469829 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4fe72f32-f6d9-42f6-966a-4e06ddc639bb tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1266 microversion: 2.1 time: 0.154335 Jul 11 14:21:41.470385 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 389/788] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:41 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:42.487269 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0fca417f-3012-47d1-8fab-cc578d69ca30 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:42.487897 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0fca417f-3012-47d1-8fab-cc578d69ca30 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:42.495087 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fca417f-3012-47d1-8fab-cc578d69ca30 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:42.495539 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fca417f-3012-47d1-8fab-cc578d69ca30 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:42.496579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fca417f-3012-47d1-8fab-cc578d69ca30 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:42.497017 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fca417f-3012-47d1-8fab-cc578d69ca30 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:42.635116 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0fca417f-3012-47d1-8fab-cc578d69ca30 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:42.642802 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0fca417f-3012-47d1-8fab-cc578d69ca30 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1266 microversion: 2.1 time: 0.159434 Jul 11 14:21:42.643379 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 400/789] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:42 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:42.864033 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-79811824-1fb6-4d58-abc9-f18d05bb91e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:42.864558 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-79811824-1fb6-4d58-abc9-f18d05bb91e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:42.868562 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:42.872865 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-79811824-1fb6-4d58-abc9-f18d05bb91e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:42.873312 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-79811824-1fb6-4d58-abc9-f18d05bb91e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:42.874077 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-79811824-1fb6-4d58-abc9-f18d05bb91e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:42.874538 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-79811824-1fb6-4d58-abc9-f18d05bb91e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:42.903222 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-79811824-1fb6-4d58-abc9-f18d05bb91e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/os-volume_attachments/dfcaedcb-e438-4785-b42e-2e9a37519749" status: 200 len: 194 microversion: 2.20 time: 0.043283 Jul 11 14:21:42.903825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 390/790] 10.222.0.66 () {60 vars in 1453 bytes} [Mon Jul 11 14:21:42 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/os-volume_attachments/dfcaedcb-e438-4785-b42e-2e9a37519749 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:21:42.970564 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cf46831c-efcd-4c4b-af25-c7886f62b1bc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:42.971065 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cf46831c-efcd-4c4b-af25-c7886f62b1bc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:42.977697 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf46831c-efcd-4c4b-af25-c7886f62b1bc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:42.978145 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf46831c-efcd-4c4b-af25-c7886f62b1bc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:42.978932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf46831c-efcd-4c4b-af25-c7886f62b1bc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:42.979365 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf46831c-efcd-4c4b-af25-c7886f62b1bc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:43.059973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-cf46831c-efcd-4c4b-af25-c7886f62b1bc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lazy-loading 'services' on Instance uuid 5c32b876-b642-4e8f-b446-3381d1f545f0 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:21:43.130965 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cf46831c-efcd-4c4b-af25-c7886f62b1bc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/os-volume_attachments/dfcaedcb-e438-4785-b42e-2e9a37519749" status: 202 len: 0 microversion: 2.20 time: 0.164121 Jul 11 14:21:43.131551 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 401/791] 10.222.0.66 () {60 vars in 1456 bytes} [Mon Jul 11 14:21:42 2022] DELETE /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/os-volume_attachments/dfcaedcb-e438-4785-b42e-2e9a37519749 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:21:43.140102 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5fa65cc5-f778-4f82-8e08-dc8092e9206e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:43.140965 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5fa65cc5-f778-4f82-8e08-dc8092e9206e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:43.147146 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5fa65cc5-f778-4f82-8e08-dc8092e9206e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:43.147630 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5fa65cc5-f778-4f82-8e08-dc8092e9206e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:43.148396 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5fa65cc5-f778-4f82-8e08-dc8092e9206e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:43.149546 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5fa65cc5-f778-4f82-8e08-dc8092e9206e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:43.153532 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=8 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:43.180850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5fa65cc5-f778-4f82-8e08-dc8092e9206e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044812 Jul 11 14:21:43.181415 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 391/792] 10.222.0.66 () {60 vars in 1342 bytes} [Mon Jul 11 14:21:43 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:21:43.661414 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e2932dc1-c73d-4bff-b7c6-83c78c9cdba5 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:43.662114 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e2932dc1-c73d-4bff-b7c6-83c78c9cdba5 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:43.668577 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2932dc1-c73d-4bff-b7c6-83c78c9cdba5 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:43.669024 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2932dc1-c73d-4bff-b7c6-83c78c9cdba5 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:43.669785 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2932dc1-c73d-4bff-b7c6-83c78c9cdba5 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:43.670243 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2932dc1-c73d-4bff-b7c6-83c78c9cdba5 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:43.811189 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e2932dc1-c73d-4bff-b7c6-83c78c9cdba5 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:43.818627 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e2932dc1-c73d-4bff-b7c6-83c78c9cdba5 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1266 microversion: 2.1 time: 0.161955 Jul 11 14:21:43.819192 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 402/793] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:43 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:44.192476 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c08c01ba-30fa-4f77-a44a-365987e362ed tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:44.193494 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c08c01ba-30fa-4f77-a44a-365987e362ed tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:44.206687 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c08c01ba-30fa-4f77-a44a-365987e362ed tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:44.207183 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c08c01ba-30fa-4f77-a44a-365987e362ed tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:44.208025 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c08c01ba-30fa-4f77-a44a-365987e362ed tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:44.208475 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c08c01ba-30fa-4f77-a44a-365987e362ed tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:44.241232 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c08c01ba-30fa-4f77-a44a-365987e362ed tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053076 Jul 11 14:21:44.241803 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 392/794] 10.222.0.66 () {60 vars in 1342 bytes} [Mon Jul 11 14:21:44 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:21:44.835991 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6d118572-40ad-4b6a-b781-40000172397c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:44.837337 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6d118572-40ad-4b6a-b781-40000172397c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:44.847467 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d118572-40ad-4b6a-b781-40000172397c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:44.847467 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d118572-40ad-4b6a-b781-40000172397c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:44.847467 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d118572-40ad-4b6a-b781-40000172397c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:44.847467 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d118572-40ad-4b6a-b781-40000172397c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:44.978826 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6d118572-40ad-4b6a-b781-40000172397c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:44.992339 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6d118572-40ad-4b6a-b781-40000172397c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1266 microversion: 2.1 time: 0.160115 Jul 11 14:21:44.992961 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 403/795] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:44 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:45.253805 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1710ef46-31c9-4abc-8eef-bb51920ef880 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:45.254897 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1710ef46-31c9-4abc-8eef-bb51920ef880 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:45.262320 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1710ef46-31c9-4abc-8eef-bb51920ef880 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:45.262755 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1710ef46-31c9-4abc-8eef-bb51920ef880 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:45.263529 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1710ef46-31c9-4abc-8eef-bb51920ef880 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:45.263967 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1710ef46-31c9-4abc-8eef-bb51920ef880 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:45.294013 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1710ef46-31c9-4abc-8eef-bb51920ef880 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044317 Jul 11 14:21:45.294632 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 393/796] 10.222.0.66 () {60 vars in 1342 bytes} [Mon Jul 11 14:21:45 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:45.352501 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-713f79ce-d57e-4ee8-82c1-44acc26c41e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:45.353016 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-713f79ce-d57e-4ee8-82c1-44acc26c41e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:45.359702 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-713f79ce-d57e-4ee8-82c1-44acc26c41e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:45.360151 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-713f79ce-d57e-4ee8-82c1-44acc26c41e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:45.360928 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-713f79ce-d57e-4ee8-82c1-44acc26c41e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:45.361375 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-713f79ce-d57e-4ee8-82c1-44acc26c41e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:45.386282 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-713f79ce-d57e-4ee8-82c1-44acc26c41e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:21:45.439765 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:45.472692 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-713f79ce-d57e-4ee8-82c1-44acc26c41e0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 204 len: 0 microversion: 2.20 time: 0.124252 Jul 11 14:21:45.473416 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 404/797] 10.222.0.66 () {60 vars in 1279 bytes} [Mon Jul 11 14:21:45 2022] DELETE /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 11 14:21:45.483577 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3917c8a3-8065-4ec1-b1eb-e0b25780a8c9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:45.484208 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3917c8a3-8065-4ec1-b1eb-e0b25780a8c9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:45.490968 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3917c8a3-8065-4ec1-b1eb-e0b25780a8c9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:45.491444 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3917c8a3-8065-4ec1-b1eb-e0b25780a8c9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:45.492220 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3917c8a3-8065-4ec1-b1eb-e0b25780a8c9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:45.492703 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3917c8a3-8065-4ec1-b1eb-e0b25780a8c9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:45.637290 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3917c8a3-8065-4ec1-b1eb-e0b25780a8c9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:45.645423 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3917c8a3-8065-4ec1-b1eb-e0b25780a8c9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:45.646985 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3917c8a3-8065-4ec1-b1eb-e0b25780a8c9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:45.648164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3917c8a3-8065-4ec1-b1eb-e0b25780a8c9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1722 microversion: 2.20 time: 0.169760 Jul 11 14:21:45.649351 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 394/798] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:21:45 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:21:46.009949 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-82061476-37f8-4437-8464-cab11df8c980 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:46.010689 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-82061476-37f8-4437-8464-cab11df8c980 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:46.018181 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82061476-37f8-4437-8464-cab11df8c980 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:46.018649 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82061476-37f8-4437-8464-cab11df8c980 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:46.019435 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82061476-37f8-4437-8464-cab11df8c980 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:46.019872 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82061476-37f8-4437-8464-cab11df8c980 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:46.158628 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-82061476-37f8-4437-8464-cab11df8c980 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:46.166351 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-82061476-37f8-4437-8464-cab11df8c980 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1266 microversion: 2.1 time: 0.161035 Jul 11 14:21:46.166930 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 405/799] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:46 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:46.667980 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ef397569-a8da-4574-a744-848d2a3237f7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:46.668600 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ef397569-a8da-4574-a744-848d2a3237f7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:46.675522 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef397569-a8da-4574-a744-848d2a3237f7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:46.676010 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef397569-a8da-4574-a744-848d2a3237f7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:46.676796 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef397569-a8da-4574-a744-848d2a3237f7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:46.677238 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef397569-a8da-4574-a744-848d2a3237f7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:46.814134 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ef397569-a8da-4574-a744-848d2a3237f7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:46.817589 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:46.823476 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ef397569-a8da-4574-a744-848d2a3237f7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:46.824931 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ef397569-a8da-4574-a744-848d2a3237f7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:46.826226 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ef397569-a8da-4574-a744-848d2a3237f7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1722 microversion: 2.20 time: 0.162702 Jul 11 14:21:46.826798 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 395/800] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:21:46 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:21:47.183856 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5b1cd436-3f20-4d3f-9142-aaa7d764a5c2 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:47.184517 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5b1cd436-3f20-4d3f-9142-aaa7d764a5c2 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:47.191493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b1cd436-3f20-4d3f-9142-aaa7d764a5c2 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:47.191953 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b1cd436-3f20-4d3f-9142-aaa7d764a5c2 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:47.192724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b1cd436-3f20-4d3f-9142-aaa7d764a5c2 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:47.193159 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b1cd436-3f20-4d3f-9142-aaa7d764a5c2 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:47.369230 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5b1cd436-3f20-4d3f-9142-aaa7d764a5c2 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:47.377452 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5b1cd436-3f20-4d3f-9142-aaa7d764a5c2 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1266 microversion: 2.1 time: 0.197723 Jul 11 14:21:47.378134 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 406/801] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:47 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:47.849315 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-786fea1b-b54d-4288-9c7d-b2d4794ccc23 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:47.850781 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-786fea1b-b54d-4288-9c7d-b2d4794ccc23 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:47.858497 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-786fea1b-b54d-4288-9c7d-b2d4794ccc23 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:47.859008 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-786fea1b-b54d-4288-9c7d-b2d4794ccc23 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:47.859792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-786fea1b-b54d-4288-9c7d-b2d4794ccc23 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:47.860260 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-786fea1b-b54d-4288-9c7d-b2d4794ccc23 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:47.934846 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-786fea1b-b54d-4288-9c7d-b2d4794ccc23 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:47.943528 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-786fea1b-b54d-4288-9c7d-b2d4794ccc23 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:47.945047 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-786fea1b-b54d-4288-9c7d-b2d4794ccc23 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:47.946617 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-786fea1b-b54d-4288-9c7d-b2d4794ccc23 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1655 microversion: 2.20 time: 0.102012 Jul 11 14:21:47.947416 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 396/802] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:21:47 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1655 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:21:47.968130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-7f7f1fae-5d14-438c-a3e9-38dcc522e440 req-d20acf5a-5ad4-4450-9b44-ddddce12ecff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c823a7a9-0fb0-42b9-af86-8cf9697b9036", "name": "network-vif-plugged", "status": "completed", "tag": "6a382ee4-94ce-4073-9f34-0eea75f61a5c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:21:47.977752 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7f7f1fae-5d14-438c-a3e9-38dcc522e440 req-d20acf5a-5ad4-4450-9b44-ddddce12ecff service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:47.978306 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7f7f1fae-5d14-438c-a3e9-38dcc522e440 req-d20acf5a-5ad4-4450-9b44-ddddce12ecff service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:47.999291 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-7f7f1fae-5d14-438c-a3e9-38dcc522e440 req-d20acf5a-5ad4-4450-9b44-ddddce12ecff service nova] Creating event network-vif-plugged:6a382ee4-94ce-4073-9f34-0eea75f61a5c for instance c823a7a9-0fb0-42b9-af86-8cf9697b9036 on hv-cinder-81914 Jul 11 14:21:48.005844 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-7f7f1fae-5d14-438c-a3e9-38dcc522e440 req-d20acf5a-5ad4-4450-9b44-ddddce12ecff service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040481 Jul 11 14:21:48.008508 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 407/803] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:21:48.181180 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-d8d0fd24-0e06-43de-be62-7f431054070f req-78a4b175-061c-4fcf-8364-b60f52f1052c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c32b876-b642-4e8f-b446-3381d1f545f0", "name": "network-vif-deleted", "tag": "b94eb482-2115-40ae-8818-8ffac7eba877"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:21:48.189288 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-d8d0fd24-0e06-43de-be62-7f431054070f req-78a4b175-061c-4fcf-8364-b60f52f1052c service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:48.189718 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-d8d0fd24-0e06-43de-be62-7f431054070f req-78a4b175-061c-4fcf-8364-b60f52f1052c service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:48.201128 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-d8d0fd24-0e06-43de-be62-7f431054070f req-78a4b175-061c-4fcf-8364-b60f52f1052c service nova] Creating event network-vif-deleted:b94eb482-2115-40ae-8818-8ffac7eba877 for instance 5c32b876-b642-4e8f-b446-3381d1f545f0 on hv-cinder-81914 Jul 11 14:21:48.206381 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-d8d0fd24-0e06-43de-be62-7f431054070f req-78a4b175-061c-4fcf-8364-b60f52f1052c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029383 Jul 11 14:21:48.206981 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 397/804] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:21:48.400103 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cbf5e30e-a42b-47bb-aa7e-808f8ec45813 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:48.402727 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cbf5e30e-a42b-47bb-aa7e-808f8ec45813 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:48.411154 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbf5e30e-a42b-47bb-aa7e-808f8ec45813 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:48.411888 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbf5e30e-a42b-47bb-aa7e-808f8ec45813 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:48.412677 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbf5e30e-a42b-47bb-aa7e-808f8ec45813 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:48.413108 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbf5e30e-a42b-47bb-aa7e-808f8ec45813 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:48.559828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cbf5e30e-a42b-47bb-aa7e-808f8ec45813 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:48.569253 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cbf5e30e-a42b-47bb-aa7e-808f8ec45813 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1266 microversion: 2.1 time: 0.175826 Jul 11 14:21:48.570252 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 408/805] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:48 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:48.967862 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9274dff4-bba2-4b1d-8876-befa1ffb6259 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:48.969231 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9274dff4-bba2-4b1d-8876-befa1ffb6259 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:48.975661 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9274dff4-bba2-4b1d-8876-befa1ffb6259 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:48.976112 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9274dff4-bba2-4b1d-8876-befa1ffb6259 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:48.976951 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9274dff4-bba2-4b1d-8876-befa1ffb6259 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:48.977388 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9274dff4-bba2-4b1d-8876-befa1ffb6259 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:49.011867 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9274dff4-bba2-4b1d-8876-befa1ffb6259 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:49.012319 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9274dff4-bba2-4b1d-8876-befa1ffb6259 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:49.012779 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-9274dff4-bba2-4b1d-8876-befa1ffb6259 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lazy-loading 'fault' on Instance uuid 5c32b876-b642-4e8f-b446-3381d1f545f0 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:21:49.058326 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9274dff4-bba2-4b1d-8876-befa1ffb6259 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:49.067012 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9274dff4-bba2-4b1d-8876-befa1ffb6259 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:49.068537 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9274dff4-bba2-4b1d-8876-befa1ffb6259 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:49.069696 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9274dff4-bba2-4b1d-8876-befa1ffb6259 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 200 len: 1370 microversion: 2.20 time: 0.108553 Jul 11 14:21:49.070330 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 398/806] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:21:48 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 1370 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:21:49.587408 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-955c9e13-93cd-45d3-b7df-3642b4c5f28e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:49.588009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-955c9e13-93cd-45d3-b7df-3642b4c5f28e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:49.594904 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-955c9e13-93cd-45d3-b7df-3642b4c5f28e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:49.595355 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-955c9e13-93cd-45d3-b7df-3642b4c5f28e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:49.596130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-955c9e13-93cd-45d3-b7df-3642b4c5f28e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:49.596567 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-955c9e13-93cd-45d3-b7df-3642b4c5f28e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:49.740981 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-955c9e13-93cd-45d3-b7df-3642b4c5f28e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:49.749813 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-955c9e13-93cd-45d3-b7df-3642b4c5f28e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1266 microversion: 2.1 time: 0.166928 Jul 11 14:21:49.750580 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 409/807] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:49 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:50.088116 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c169d3f7-0268-4307-b464-ea643a779740 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:50.088727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c169d3f7-0268-4307-b464-ea643a779740 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:50.095214 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c169d3f7-0268-4307-b464-ea643a779740 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:50.095662 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c169d3f7-0268-4307-b464-ea643a779740 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:50.096426 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c169d3f7-0268-4307-b464-ea643a779740 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:50.096864 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c169d3f7-0268-4307-b464-ea643a779740 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:50.110480 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-c169d3f7-0268-4307-b464-ea643a779740 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] HTTP exception thrown: Instance 5c32b876-b642-4e8f-b446-3381d1f545f0 could not be found. Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c169d3f7-0268-4307-b464-ea643a779740 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Request method failure captured: Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 HTTP/1.1 Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDFQrLza8OpbribeP2OFzZ6bTK5hfozZ39l1B0FblmeUflqdWTwui0ZphovPiopfYGJUpS5F0WQ5oGKN7tyX-KifzCLUyB1dQXUfAHz3__RFnUM9V-2uDDRfnTCtqwk6j9QMt98StEpM_FlR1WUSGqRJwg-pSPAZbwRlKsAiyC_ETdg Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 4463cb0c8f5d473f955e0f08eb7b4e7f Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1900292035 Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:21:50.112159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:21:50.113929 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:21:50.113929 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1900292035 Jul 11 14:21:50.113929 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 4463cb0c8f5d473f955e0f08eb7b4e7f Jul 11 14:21:50.113929 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1900292035 Jul 11 14:21:50.113929 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeShelveTestJSON-1900292035-project Jul 11 14:21:50.113929 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:21:50.113929 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:21:50.113929 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 999bc8975c43406c838e5c4bb2af1e53 Jul 11 14:21:50.113929 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1900292035-project Jul 11 14:21:50.113929 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:21:50.113929 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance 5c32b876-b642-4e8f-b446-3381d1f545f0 could not be found. Jul 11 14:21:50.113929 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': '5c32b876-b642-4e8f-b446-3381d1f545f0'} Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c32b876-b642-4e8f-b446-3381d1f545f0 could not be found. Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:21:50.115087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:21:50.116686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:21:50.116686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:21:50.116686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:21:50.116686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:21:50.116686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:21:50.116686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:21:50.116686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:21:50.116686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c32b876-b642-4e8f-b446-3381d1f545f0 could not be found. Jul 11 14:21:50.116686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:21:50.116686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:21:50.116686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:21:50.116686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:21:50.116686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:21:50.116686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:21:50.116686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:21:50.116686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:21:50.116686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c32b876-b642-4e8f-b446-3381d1f545f0 could not be found. Jul 11 14:21:50.116686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:21:50.119051 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c169d3f7-0268-4307-b464-ea643a779740 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Returning 404 to user: Instance 5c32b876-b642-4e8f-b446-3381d1f545f0 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:21:50.119051 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c169d3f7-0268-4307-b464-ea643a779740 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 404 len: 111 microversion: 2.20 time: 0.029400 Jul 11 14:21:50.119051 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 399/808] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:21:50 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 14:21:50.123200 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1e3de77b-c7a1-4a84-a64f-b04d3e75f74d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '.version_select at 0x7fc976a979d0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:50.144324 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1e3de77b-c7a1-4a84-a64f-b04d3e75f74d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-165752955" status: 204 len: 0 microversion: 2.20 time: 0.025146 Jul 11 14:21:50.144901 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 410/809] 10.222.0.66 () {60 vars in 1258 bytes} [Mon Jul 11 14:21:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-165752955 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 11 14:21:50.766049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-85cc4573-cc7b-4edd-97a1-662ec62a142d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Action: 'create', calling method: .version_select at 0x7fc976abe3a0>, body: {"keypair": {"name": "tempest-keypair-1964658321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs1z+VOcKse6BtlLeo21ptnmPerdUs7EPG0Imb8qQugjkb3dmpbp2HcYvTHfHwSb/x60lP/WUsD0pziIB+WflPmv+uhXK/eI836DF/iKgFAXatYZFSBzmemnGcLvzIksg=="}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:21:50.767629 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9a9437e2-89b3-4f99-ae09-4633d2121117 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:50.768245 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9a9437e2-89b3-4f99-ae09-4633d2121117 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:50.774487 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a9437e2-89b3-4f99-ae09-4633d2121117 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:50.774891 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a9437e2-89b3-4f99-ae09-4633d2121117 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:50.775659 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a9437e2-89b3-4f99-ae09-4633d2121117 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:50.776095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a9437e2-89b3-4f99-ae09-4633d2121117 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:50.780247 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-85cc4573-cc7b-4edd-97a1-662ec62a142d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Getting quotas for project 4463cb0c8f5d473f955e0f08eb7b4e7f. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:21:50.784392 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-85cc4573-cc7b-4edd-97a1-662ec62a142d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Getting quotas for user 999bc8975c43406c838e5c4bb2af1e53 and project 4463cb0c8f5d473f955e0f08eb7b4e7f. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:21:50.808004 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-85cc4573-cc7b-4edd-97a1-662ec62a142d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045670 Jul 11 14:21:50.808617 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 400/810] 10.222.0.66 () {62 vars in 1199 bytes} [Mon Jul 11 14:21:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 11 14:21:50.919868 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9a9437e2-89b3-4f99-ae09-4633d2121117 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:50.927681 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9a9437e2-89b3-4f99-ae09-4633d2121117 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1452 microversion: 2.1 time: 0.164197 Jul 11 14:21:50.928281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 411/811] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:50 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:21:50.944181 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-324f2e39-c98b-4ef4-a4cb-8b1d7a9ee729 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:50.944787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-324f2e39-c98b-4ef4-a4cb-8b1d7a9ee729 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:50.951090 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-324f2e39-c98b-4ef4-a4cb-8b1d7a9ee729 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:50.951522 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-324f2e39-c98b-4ef4-a4cb-8b1d7a9ee729 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:50.952293 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-324f2e39-c98b-4ef4-a4cb-8b1d7a9ee729 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:50.952720 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-324f2e39-c98b-4ef4-a4cb-8b1d7a9ee729 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:51.101395 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-324f2e39-c98b-4ef4-a4cb-8b1d7a9ee729 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:51.110424 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-324f2e39-c98b-4ef4-a4cb-8b1d7a9ee729 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1452 microversion: 2.1 time: 0.169937 Jul 11 14:21:51.110985 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 401/812] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:50 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:52.691986 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-12868b4e-fb87-47d7-82fb-23a948f3f891 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1880860906", "imageRef": "67874ac7-fac8-4d6d-9cd1-9091ecb957b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18750740-4061-422d-a7cb-f13aa63e24aa"}], "security_groups": [{"name": "tempest-securitygroup--1872449879"}], "key_name": "tempest-keypair-1964658321", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:21:52.803203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-12868b4e-fb87-47d7-82fb-23a948f3f891 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] validate_networks() for [('18750740-4061-422d-a7cb-f13aa63e24aa', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:21:53.194489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-12868b4e-fb87-47d7-82fb-23a948f3f891 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:21:53.195020 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-12868b4e-fb87-47d7-82fb-23a948f3f891 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:21:53.195678 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-12868b4e-fb87-47d7-82fb-23a948f3f891 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:21:53.196187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-12868b4e-fb87-47d7-82fb-23a948f3f891 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:21:53.196695 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-12868b4e-fb87-47d7-82fb-23a948f3f891 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:21:53.206473 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12868b4e-fb87-47d7-82fb-23a948f3f891 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:53.206913 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12868b4e-fb87-47d7-82fb-23a948f3f891 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:53.207711 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12868b4e-fb87-47d7-82fb-23a948f3f891 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:53.208369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12868b4e-fb87-47d7-82fb-23a948f3f891 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:53.227327 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-12868b4e-fb87-47d7-82fb-23a948f3f891 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Getting quotas for project 4463cb0c8f5d473f955e0f08eb7b4e7f. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:21:53.231474 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-12868b4e-fb87-47d7-82fb-23a948f3f891 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Getting quotas for user 999bc8975c43406c838e5c4bb2af1e53 and project 4463cb0c8f5d473f955e0f08eb7b4e7f. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:21:53.242724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-12868b4e-fb87-47d7-82fb-23a948f3f891 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:21:53.244894 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-12868b4e-fb87-47d7-82fb-23a948f3f891 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67874ac7-fac8-4d6d-9cd1-9091ecb957b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:21:53.291389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-12868b4e-fb87-47d7-82fb-23a948f3f891 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.603640 Jul 11 14:21:53.292546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 412/813] 10.222.0.66 () {62 vars in 1187 bytes} [Mon Jul 11 14:21:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 11 14:21:53.309201 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e4cff4b5-1ede-45dd-b7b2-e973a7c45112 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:53.309936 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e4cff4b5-1ede-45dd-b7b2-e973a7c45112 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:53.385752 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e4cff4b5-1ede-45dd-b7b2-e973a7c45112 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:53.396559 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e4cff4b5-1ede-45dd-b7b2-e973a7c45112 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:53.399201 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e4cff4b5-1ede-45dd-b7b2-e973a7c45112 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:53.400511 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e4cff4b5-1ede-45dd-b7b2-e973a7c45112 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1282 microversion: 2.20 time: 0.096422 Jul 11 14:21:53.401211 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 402/814] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:21:53 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:21:53.890448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-bf73a3cc-d158-4da2-b7a5-3278d9f26b21 req-26c62643-33a4-4cb3-9dc9-78b3c9e47417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c823a7a9-0fb0-42b9-af86-8cf9697b9036", "tag": "6a382ee4-94ce-4073-9f34-0eea75f61a5c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:21:53.900605 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-bf73a3cc-d158-4da2-b7a5-3278d9f26b21 req-26c62643-33a4-4cb3-9dc9-78b3c9e47417 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:53.901054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-bf73a3cc-d158-4da2-b7a5-3278d9f26b21 req-26c62643-33a4-4cb3-9dc9-78b3c9e47417 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:53.914521 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-bf73a3cc-d158-4da2-b7a5-3278d9f26b21 req-26c62643-33a4-4cb3-9dc9-78b3c9e47417 service nova] Creating event network-changed:6a382ee4-94ce-4073-9f34-0eea75f61a5c for instance c823a7a9-0fb0-42b9-af86-8cf9697b9036 on hv-cinder-81914 Jul 11 14:21:53.919667 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-bf73a3cc-d158-4da2-b7a5-3278d9f26b21 req-26c62643-33a4-4cb3-9dc9-78b3c9e47417 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033606 Jul 11 14:21:53.920280 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 413/815] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:21:54.419297 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b003aa06-29a4-4d59-84a1-442af6aef8cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:54.420574 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b003aa06-29a4-4d59-84a1-442af6aef8cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:54.423362 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:54.431880 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b003aa06-29a4-4d59-84a1-442af6aef8cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:54.432624 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b003aa06-29a4-4d59-84a1-442af6aef8cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:54.433596 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b003aa06-29a4-4d59-84a1-442af6aef8cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:54.434481 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b003aa06-29a4-4d59-84a1-442af6aef8cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:54.513618 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b003aa06-29a4-4d59-84a1-442af6aef8cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:54.525271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b003aa06-29a4-4d59-84a1-442af6aef8cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:54.527823 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b003aa06-29a4-4d59-84a1-442af6aef8cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:54.529126 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b003aa06-29a4-4d59-84a1-442af6aef8cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1342 microversion: 2.20 time: 0.113974 Jul 11 14:21:54.530406 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 403/816] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:21:54 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1342 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:21:55.550007 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-df474c4d-14fb-4ee2-ac4d-6bdd7c331a82 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:55.550765 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-df474c4d-14fb-4ee2-ac4d-6bdd7c331a82 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:55.560019 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df474c4d-14fb-4ee2-ac4d-6bdd7c331a82 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:55.560765 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df474c4d-14fb-4ee2-ac4d-6bdd7c331a82 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:55.561571 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df474c4d-14fb-4ee2-ac4d-6bdd7c331a82 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:55.562016 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df474c4d-14fb-4ee2-ac4d-6bdd7c331a82 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:55.801350 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-df474c4d-14fb-4ee2-ac4d-6bdd7c331a82 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:55.810184 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-df474c4d-14fb-4ee2-ac4d-6bdd7c331a82 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:55.811706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-df474c4d-14fb-4ee2-ac4d-6bdd7c331a82 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:55.812836 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-df474c4d-14fb-4ee2-ac4d-6bdd7c331a82 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1408 microversion: 2.20 time: 0.267758 Jul 11 14:21:55.813409 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 414/817] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:21:55 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1408 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:21:56.458797 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-f2fa1236-7e93-4332-adb2-89727329cfb2 req-e23fb49b-227c-4ab5-af5e-d4601f25ce20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a20f292-9867-4b58-a3eb-12f153edd3aa", "tag": "802d4a9e-0fa0-41e8-876a-385488fc4283"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:21:56.468904 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f2fa1236-7e93-4332-adb2-89727329cfb2 req-e23fb49b-227c-4ab5-af5e-d4601f25ce20 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:56.469353 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f2fa1236-7e93-4332-adb2-89727329cfb2 req-e23fb49b-227c-4ab5-af5e-d4601f25ce20 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:56.493172 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-f2fa1236-7e93-4332-adb2-89727329cfb2 req-e23fb49b-227c-4ab5-af5e-d4601f25ce20 service nova] Creating event network-changed:802d4a9e-0fa0-41e8-876a-385488fc4283 for instance 5a20f292-9867-4b58-a3eb-12f153edd3aa on hv-cinder-81914 Jul 11 14:21:56.498910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-f2fa1236-7e93-4332-adb2-89727329cfb2 req-e23fb49b-227c-4ab5-af5e-d4601f25ce20 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043778 Jul 11 14:21:56.499927 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 404/818] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:21:56.831573 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-16cc18c6-f7bb-4b03-baee-6001fe1a1cff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:56.832224 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-16cc18c6-f7bb-4b03-baee-6001fe1a1cff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:56.839111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16cc18c6-f7bb-4b03-baee-6001fe1a1cff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:56.839562 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16cc18c6-f7bb-4b03-baee-6001fe1a1cff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:56.840341 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16cc18c6-f7bb-4b03-baee-6001fe1a1cff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:56.840816 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16cc18c6-f7bb-4b03-baee-6001fe1a1cff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:57.026113 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-16cc18c6-f7bb-4b03-baee-6001fe1a1cff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:57.034404 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-16cc18c6-f7bb-4b03-baee-6001fe1a1cff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:57.035908 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-16cc18c6-f7bb-4b03-baee-6001fe1a1cff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:57.037019 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-16cc18c6-f7bb-4b03-baee-6001fe1a1cff tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1408 microversion: 2.20 time: 0.209348 Jul 11 14:21:57.037585 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 415/819] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:21:56 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:21:58.058116 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-36554659-6649-4743-bfe4-488c81be2902 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:58.058585 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-36554659-6649-4743-bfe4-488c81be2902 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:58.066729 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-36554659-6649-4743-bfe4-488c81be2902 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:58.067172 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-36554659-6649-4743-bfe4-488c81be2902 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:58.067940 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-36554659-6649-4743-bfe4-488c81be2902 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:58.068368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-36554659-6649-4743-bfe4-488c81be2902 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:58.208536 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-36554659-6649-4743-bfe4-488c81be2902 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:58.217013 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-36554659-6649-4743-bfe4-488c81be2902 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:58.218567 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-36554659-6649-4743-bfe4-488c81be2902 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:58.219685 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-36554659-6649-4743-bfe4-488c81be2902 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1408 microversion: 2.20 time: 0.167339 Jul 11 14:21:58.220253 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 405/820] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:21:58 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:21:59.238374 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a8125a37-041b-495f-af55-db597b7a5be4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:59.238988 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a8125a37-041b-495f-af55-db597b7a5be4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:59.245937 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a8125a37-041b-495f-af55-db597b7a5be4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:59.246428 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a8125a37-041b-495f-af55-db597b7a5be4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:59.247257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a8125a37-041b-495f-af55-db597b7a5be4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:59.247694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a8125a37-041b-495f-af55-db597b7a5be4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:59.383719 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a8125a37-041b-495f-af55-db597b7a5be4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:59.392374 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a8125a37-041b-495f-af55-db597b7a5be4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:59.393980 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a8125a37-041b-495f-af55-db597b7a5be4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:59.395084 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a8125a37-041b-495f-af55-db597b7a5be4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1408 microversion: 2.20 time: 0.160706 Jul 11 14:21:59.395647 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 416/821] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:21:59 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:22:00.412972 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9c9386fc-6781-4518-be05-426f8e249956 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:00.414245 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9c9386fc-6781-4518-be05-426f8e249956 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:00.421648 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9c9386fc-6781-4518-be05-426f8e249956 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:00.422184 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9c9386fc-6781-4518-be05-426f8e249956 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:00.422900 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9c9386fc-6781-4518-be05-426f8e249956 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:00.423332 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9c9386fc-6781-4518-be05-426f8e249956 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:00.572914 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9c9386fc-6781-4518-be05-426f8e249956 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:00.581171 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9c9386fc-6781-4518-be05-426f8e249956 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:00.582701 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9c9386fc-6781-4518-be05-426f8e249956 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:00.583811 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9c9386fc-6781-4518-be05-426f8e249956 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1408 microversion: 2.20 time: 0.174908 Jul 11 14:22:00.584456 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 406/822] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:22:00 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:22:01.601110 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8a1274ce-f86c-4966-999f-da95279557b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:01.601810 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8a1274ce-f86c-4966-999f-da95279557b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:01.608366 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a1274ce-f86c-4966-999f-da95279557b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:01.608812 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a1274ce-f86c-4966-999f-da95279557b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:01.609574 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a1274ce-f86c-4966-999f-da95279557b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:01.610007 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a1274ce-f86c-4966-999f-da95279557b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:01.744520 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8a1274ce-f86c-4966-999f-da95279557b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:01.753820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8a1274ce-f86c-4966-999f-da95279557b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:01.755423 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8a1274ce-f86c-4966-999f-da95279557b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:01.756594 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8a1274ce-f86c-4966-999f-da95279557b1 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1408 microversion: 2.20 time: 0.159569 Jul 11 14:22:01.757816 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 417/823] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:22:01 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:22:02.039289 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-11b0dc4e-164c-40b0-8e57-4503ef6c1440 req-b7614d71-5eaa-497f-96ab-b3ab373107c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a20f292-9867-4b58-a3eb-12f153edd3aa", "name": "network-vif-plugged", "status": "completed", "tag": "802d4a9e-0fa0-41e8-876a-385488fc4283"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:22:02.049054 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-11b0dc4e-164c-40b0-8e57-4503ef6c1440 req-b7614d71-5eaa-497f-96ab-b3ab373107c9 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:02.050241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-11b0dc4e-164c-40b0-8e57-4503ef6c1440 req-b7614d71-5eaa-497f-96ab-b3ab373107c9 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:02.062401 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-11b0dc4e-164c-40b0-8e57-4503ef6c1440 req-b7614d71-5eaa-497f-96ab-b3ab373107c9 service nova] Creating event network-vif-plugged:802d4a9e-0fa0-41e8-876a-385488fc4283 for instance 5a20f292-9867-4b58-a3eb-12f153edd3aa on hv-cinder-81914 Jul 11 14:22:02.067266 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-11b0dc4e-164c-40b0-8e57-4503ef6c1440 req-b7614d71-5eaa-497f-96ab-b3ab373107c9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032563 Jul 11 14:22:02.068338 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 407/824] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:22:02.775912 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-941f6c63-d796-4c82-ac04-1d37eff36b45 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:02.776533 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-941f6c63-d796-4c82-ac04-1d37eff36b45 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:02.778982 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:02.784536 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-941f6c63-d796-4c82-ac04-1d37eff36b45 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:02.785048 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-941f6c63-d796-4c82-ac04-1d37eff36b45 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:02.785823 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-941f6c63-d796-4c82-ac04-1d37eff36b45 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:02.786289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-941f6c63-d796-4c82-ac04-1d37eff36b45 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:02.920705 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-941f6c63-d796-4c82-ac04-1d37eff36b45 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:02.928700 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-941f6c63-d796-4c82-ac04-1d37eff36b45 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:02.930959 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-941f6c63-d796-4c82-ac04-1d37eff36b45 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:02.932082 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-941f6c63-d796-4c82-ac04-1d37eff36b45 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1408 microversion: 2.20 time: 0.160742 Jul 11 14:22:02.932648 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 418/825] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:22:02 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:22:03.952222 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fe2078d8-b524-4e0d-aeb8-5532fd77035b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:03.952983 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fe2078d8-b524-4e0d-aeb8-5532fd77035b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:03.955529 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:03.961967 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fe2078d8-b524-4e0d-aeb8-5532fd77035b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:03.962431 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fe2078d8-b524-4e0d-aeb8-5532fd77035b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:03.963197 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fe2078d8-b524-4e0d-aeb8-5532fd77035b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:03.963621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fe2078d8-b524-4e0d-aeb8-5532fd77035b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:04.101760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fe2078d8-b524-4e0d-aeb8-5532fd77035b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:04.110229 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fe2078d8-b524-4e0d-aeb8-5532fd77035b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:04.111773 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fe2078d8-b524-4e0d-aeb8-5532fd77035b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:04.112883 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fe2078d8-b524-4e0d-aeb8-5532fd77035b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1408 microversion: 2.20 time: 0.165410 Jul 11 14:22:04.113448 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 408/826] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:22:03 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:22:05.131923 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-40c70c3e-93fc-48e0-a424-cd31f4b83a46 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:05.132493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-40c70c3e-93fc-48e0-a424-cd31f4b83a46 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:05.134458 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:05.135258 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:05.141801 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-40c70c3e-93fc-48e0-a424-cd31f4b83a46 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:05.142320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-40c70c3e-93fc-48e0-a424-cd31f4b83a46 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:05.143099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-40c70c3e-93fc-48e0-a424-cd31f4b83a46 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:05.143559 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-40c70c3e-93fc-48e0-a424-cd31f4b83a46 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:05.283319 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-40c70c3e-93fc-48e0-a424-cd31f4b83a46 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:05.292642 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-40c70c3e-93fc-48e0-a424-cd31f4b83a46 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:05.294175 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-40c70c3e-93fc-48e0-a424-cd31f4b83a46 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:05.295361 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-40c70c3e-93fc-48e0-a424-cd31f4b83a46 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1601 microversion: 2.20 time: 0.167512 Jul 11 14:22:05.295930 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 419/827] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:22:05 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1601 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:22:05.313436 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-84be8af0-7876-4ae1-9023-431f0bec62df tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:05.313969 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-84be8af0-7876-4ae1-9023-431f0bec62df tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:05.320581 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-84be8af0-7876-4ae1-9023-431f0bec62df tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:05.321029 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-84be8af0-7876-4ae1-9023-431f0bec62df tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:05.321868 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-84be8af0-7876-4ae1-9023-431f0bec62df tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:05.322388 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-84be8af0-7876-4ae1-9023-431f0bec62df tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:05.406115 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-84be8af0-7876-4ae1-9023-431f0bec62df tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096919 Jul 11 14:22:05.406766 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 409/828] 10.222.0.66 () {60 vars in 1315 bytes} [Mon Jul 11 14:22:05 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:22:06.350202 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-ca932b30-df30-44b4-afaf-e81e7bac996a req-9ef2930f-a88b-4b05-b436-78f9abd1af3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a20f292-9867-4b58-a3eb-12f153edd3aa", "tag": "802d4a9e-0fa0-41e8-876a-385488fc4283"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:22:06.359021 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ca932b30-df30-44b4-afaf-e81e7bac996a req-9ef2930f-a88b-4b05-b436-78f9abd1af3c service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:06.359456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ca932b30-df30-44b4-afaf-e81e7bac996a req-9ef2930f-a88b-4b05-b436-78f9abd1af3c service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:06.371244 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-ca932b30-df30-44b4-afaf-e81e7bac996a req-9ef2930f-a88b-4b05-b436-78f9abd1af3c service nova] Creating event network-changed:802d4a9e-0fa0-41e8-876a-385488fc4283 for instance 5a20f292-9867-4b58-a3eb-12f153edd3aa on hv-cinder-81914 Jul 11 14:22:06.376260 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-ca932b30-df30-44b4-afaf-e81e7bac996a req-9ef2930f-a88b-4b05-b436-78f9abd1af3c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029774 Jul 11 14:22:06.376859 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 420/829] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:22:12.679921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-02e9d21d-3eec-419c-8e1d-55c24c061105 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:12.680477 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-02e9d21d-3eec-419c-8e1d-55c24c061105 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:12.686519 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-02e9d21d-3eec-419c-8e1d-55c24c061105 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:12.686970 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-02e9d21d-3eec-419c-8e1d-55c24c061105 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:12.687737 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-02e9d21d-3eec-419c-8e1d-55c24c061105 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:12.688180 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-02e9d21d-3eec-419c-8e1d-55c24c061105 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:12.712469 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-02e9d21d-3eec-419c-8e1d-55c24c061105 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0/ips" status: 200 len: 149 microversion: 2.1 time: 0.037129 Jul 11 14:22:12.713043 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 410/830] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 11 14:22:12 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:22:12.724153 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-85b59a48-be8d-4bb8-b47e-8b09993ade74 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d716f2f3-e89d-41f1-8bb0-d29f56e96ba5"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:22:12.725349 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-85b59a48-be8d-4bb8-b47e-8b09993ade74 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:12.732424 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85b59a48-be8d-4bb8-b47e-8b09993ade74 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:12.732875 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85b59a48-be8d-4bb8-b47e-8b09993ade74 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:12.733640 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85b59a48-be8d-4bb8-b47e-8b09993ade74 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:12.734070 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85b59a48-be8d-4bb8-b47e-8b09993ade74 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:12.812924 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-85b59a48-be8d-4bb8-b47e-8b09993ade74 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] HTTP exception thrown: Invalid volume: volume d716f2f3-e89d-41f1-8bb0-d29f56e96ba5 is already attached to instances: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-85b59a48-be8d-4bb8-b47e-8b09993ade74 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Request method failure captured: Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: POST /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0/os-volume_attachments HTTP/1.1 Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 74 Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDGazgesZ8gm-xkGX3sogYiEnmE9DbvhKeeh7tJMTX6Y58vVTm48pJ0qqerjCEqeh3Rk7vIu5Mf6TPbuSudm7DddzzEsc9NjqbILyr7XHvKKA7DT_oLLVUIhEbYpW0g3TYtb5AJyNnSid_YkDT-vH95HrvzbM46bM90tJC5hswTE0Jw Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:22:12.814735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:22:12.816276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:22:12.816276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:22:12.816276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:22:12.816276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:22:12.816276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:22:12.816276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:22:12.816276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:22:12.816276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 5bbea49c1a55481c9995f04f2e9b8618 Jul 11 14:22:12.816276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:22:12.816276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Jul 11 14:22:12.816276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {"volumeAttachment": {"volumeId": "d716f2f3-e89d-41f1-8bb0-d29f56e96ba5"}} Jul 11 14:22:12.816276 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Invalid volume: volume d716f2f3-e89d-41f1-8bb0-d29f56e96ba5 is already attached to instances: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'server_id': '362320ea-1be9-4e52-b970-1ad8ea945ea0', 'body': {'volumeAttachment': {'volumeId': 'd716f2f3-e89d-41f1-8bb0-d29f56e96ba5'}}} Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d716f2f3-e89d-41f1-8bb0-d29f56e96ba5 is already attached to instances: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:22:12.817311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d716f2f3-e89d-41f1-8bb0-d29f56e96ba5 is already attached to instances: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:22:12.819009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:22:12.821206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:22:12.821206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:22:12.821206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:22:12.821206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d716f2f3-e89d-41f1-8bb0-d29f56e96ba5 is already attached to instances: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e Jul 11 14:22:12.821206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:22:12.821206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-85b59a48-be8d-4bb8-b47e-8b09993ade74 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Returning 400 to user: Invalid volume: volume d716f2f3-e89d-41f1-8bb0-d29f56e96ba5 is already attached to instances: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:22:12.821206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-85b59a48-be8d-4bb8-b47e-8b09993ade74 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "POST /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096366 Jul 11 14:22:12.821206 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 421/831] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 11 14:22:12 2022] POST /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 14:22:12.825558 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ea6b9853-32d7-4fe5-ae7e-8ced168ac747 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:12.826054 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ea6b9853-32d7-4fe5-ae7e-8ced168ac747 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:12.832241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea6b9853-32d7-4fe5-ae7e-8ced168ac747 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:12.832693 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea6b9853-32d7-4fe5-ae7e-8ced168ac747 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:12.833448 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea6b9853-32d7-4fe5-ae7e-8ced168ac747 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:12.833879 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea6b9853-32d7-4fe5-ae7e-8ced168ac747 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:12.863178 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ea6b9853-32d7-4fe5-ae7e-8ced168ac747 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:22:12.943841 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ea6b9853-32d7-4fe5-ae7e-8ced168ac747 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "DELETE /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 204 len: 0 microversion: 2.1 time: 0.121342 Jul 11 14:22:12.945389 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 411/832] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:22:12 2022] DELETE /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:22:12.955397 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9e32844f-4e0f-4156-933e-08fa4a5ef9f5 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:12.956118 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9e32844f-4e0f-4156-933e-08fa4a5ef9f5 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:12.963591 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e32844f-4e0f-4156-933e-08fa4a5ef9f5 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:12.964099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e32844f-4e0f-4156-933e-08fa4a5ef9f5 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:12.965018 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e32844f-4e0f-4156-933e-08fa4a5ef9f5 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:12.965469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e32844f-4e0f-4156-933e-08fa4a5ef9f5 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:13.102845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9e32844f-4e0f-4156-933e-08fa4a5ef9f5 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:13.110519 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9e32844f-4e0f-4156-933e-08fa4a5ef9f5 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 200 len: 1679 microversion: 2.1 time: 0.159466 Jul 11 14:22:13.111091 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 422/833] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:12 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:14.129557 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d23734cc-c460-42dc-8a0f-79a446241997 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:14.130184 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d23734cc-c460-42dc-8a0f-79a446241997 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:14.137516 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d23734cc-c460-42dc-8a0f-79a446241997 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:14.137965 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d23734cc-c460-42dc-8a0f-79a446241997 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:14.138757 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d23734cc-c460-42dc-8a0f-79a446241997 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:14.139189 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d23734cc-c460-42dc-8a0f-79a446241997 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:14.275008 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d23734cc-c460-42dc-8a0f-79a446241997 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:14.282495 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d23734cc-c460-42dc-8a0f-79a446241997 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 200 len: 1679 microversion: 2.1 time: 0.157230 Jul 11 14:22:14.283126 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 412/834] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:14 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:15.300007 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9544f72e-8f32-418b-8bac-4e5da208f9d7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:15.300639 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9544f72e-8f32-418b-8bac-4e5da208f9d7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:15.308026 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9544f72e-8f32-418b-8bac-4e5da208f9d7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:15.308479 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9544f72e-8f32-418b-8bac-4e5da208f9d7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:15.309257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9544f72e-8f32-418b-8bac-4e5da208f9d7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:15.309711 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9544f72e-8f32-418b-8bac-4e5da208f9d7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:15.376816 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9544f72e-8f32-418b-8bac-4e5da208f9d7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:15.384591 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9544f72e-8f32-418b-8bac-4e5da208f9d7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 200 len: 1611 microversion: 2.1 time: 0.088470 Jul 11 14:22:15.385172 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 423/835] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:15 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 1611 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:15.481013 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-fc809e5a-9518-4493-921f-9436eb7b4c44 req-74d7a658-1042-4c09-b499-8c2463a18a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362320ea-1be9-4e52-b970-1ad8ea945ea0", "name": "network-vif-deleted", "tag": "a84bc9e7-18dd-4e8c-80ff-531b1330d93e"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:22:15.490087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-fc809e5a-9518-4493-921f-9436eb7b4c44 req-74d7a658-1042-4c09-b499-8c2463a18a42 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:15.490586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-fc809e5a-9518-4493-921f-9436eb7b4c44 req-74d7a658-1042-4c09-b499-8c2463a18a42 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:15.503554 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-fc809e5a-9518-4493-921f-9436eb7b4c44 req-74d7a658-1042-4c09-b499-8c2463a18a42 service nova] Creating event network-vif-deleted:a84bc9e7-18dd-4e8c-80ff-531b1330d93e for instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 on hv-cinder-81914 Jul 11 14:22:15.508748 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-fc809e5a-9518-4493-921f-9436eb7b4c44 req-74d7a658-1042-4c09-b499-8c2463a18a42 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031715 Jul 11 14:22:15.509703 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 413/836] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:22:16.401875 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4903dd36-5e4c-4527-be06-c234ed24b2b3 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:16.402512 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4903dd36-5e4c-4527-be06-c234ed24b2b3 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:16.409294 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4903dd36-5e4c-4527-be06-c234ed24b2b3 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:16.409744 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4903dd36-5e4c-4527-be06-c234ed24b2b3 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:16.410565 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4903dd36-5e4c-4527-be06-c234ed24b2b3 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:16.411005 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4903dd36-5e4c-4527-be06-c234ed24b2b3 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:16.414304 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=93 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:16.427764 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-4903dd36-5e4c-4527-be06-c234ed24b2b3 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] HTTP exception thrown: Instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 could not be found. Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4903dd36-5e4c-4527-be06-c234ed24b2b3 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Request method failure captured: Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 HTTP/1.1 Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDGazgesZ8gm-xkGX3sogYiEnmE9DbvhKeeh7tJMTX6Y58vVTm48pJ0qqerjCEqeh3Rk7vIu5Mf6TPbuSudm7DddzzEsc9NjqbILyr7XHvKKA7DT_oLLVUIhEbYpW0g3TYtb5AJyNnSid_YkDT-vH95HrvzbM46bM90tJC5hswTE0Jw Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:22:16.429546 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:22:16.431053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:22:16.431053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:22:16.431053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:22:16.431053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:22:16.431053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:22:16.431053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:22:16.431053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:22:16.431053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 5bbea49c1a55481c9995f04f2e9b8618 Jul 11 14:22:16.431053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:22:16.431053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:22:16.431053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 could not be found. Jul 11 14:22:16.431053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': '362320ea-1be9-4e52-b970-1ad8ea945ea0'} Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 could not be found. Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:22:16.431975 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:22:16.433389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:22:16.433389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:22:16.433389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:22:16.433389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:22:16.433389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:22:16.433389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:22:16.433389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:22:16.433389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 could not be found. Jul 11 14:22:16.433389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:22:16.433389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:22:16.433389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:22:16.433389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:22:16.433389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:22:16.433389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:22:16.433389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:22:16.433389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:22:16.433389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 could not be found. Jul 11 14:22:16.433389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:22:16.434615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4903dd36-5e4c-4527-be06-c234ed24b2b3 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Returning 404 to user: Instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:22:16.434615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4903dd36-5e4c-4527-be06-c234ed24b2b3 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 404 len: 111 microversion: 2.1 time: 0.033800 Jul 11 14:22:16.434615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 424/837] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:16 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:22:16.441683 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f331d4e5-40d0-4479-8bf2-c6dae1759eb0 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '.version_select at 0x7fc976b39160>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:16.461906 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f331d4e5-40d0-4479-8bf2-c6dae1759eb0 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-93337798" status: 202 len: 0 microversion: 2.1 time: 0.024486 Jul 11 14:22:16.462574 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 414/838] 10.222.0.66 () {58 vars in 1214 bytes} [Mon Jul 11 14:22:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-93337798 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:22:17.177892 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e43aa07f-5520-4d5f-af80-177bf4029f60 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:17.178496 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e43aa07f-5520-4d5f-af80-177bf4029f60 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:17.185462 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e43aa07f-5520-4d5f-af80-177bf4029f60 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:17.185915 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e43aa07f-5520-4d5f-af80-177bf4029f60 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:17.186725 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e43aa07f-5520-4d5f-af80-177bf4029f60 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:17.187166 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e43aa07f-5520-4d5f-af80-177bf4029f60 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:17.270149 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-e43aa07f-5520-4d5f-af80-177bf4029f60 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lazy-loading 'services' on Instance uuid de5ec3b0-8851-4d21-a2ec-5a3e5487d73e {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:22:17.340591 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e43aa07f-5520-4d5f-af80-177bf4029f60 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "DELETE /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e/os-volume_attachments/d716f2f3-e89d-41f1-8bb0-d29f56e96ba5" status: 202 len: 0 microversion: 2.1 time: 0.167719 Jul 11 14:22:17.341192 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 425/839] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 11 14:22:17 2022] DELETE /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e/os-volume_attachments/d716f2f3-e89d-41f1-8bb0-d29f56e96ba5 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:22:17.349664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d73a73c1-e9c3-4943-9319-5e7e166ab633 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:17.351078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d73a73c1-e9c3-4943-9319-5e7e166ab633 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:17.358654 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d73a73c1-e9c3-4943-9319-5e7e166ab633 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:17.359266 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d73a73c1-e9c3-4943-9319-5e7e166ab633 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:17.360098 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d73a73c1-e9c3-4943-9319-5e7e166ab633 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:17.360637 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d73a73c1-e9c3-4943-9319-5e7e166ab633 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:17.391958 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d73a73c1-e9c3-4943-9319-5e7e166ab633 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046197 Jul 11 14:22:17.392517 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 415/840] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:22:17 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:22:18.405875 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7176046b-966e-4f51-a63a-9d5bd69baa1f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:18.407018 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7176046b-966e-4f51-a63a-9d5bd69baa1f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:18.413392 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7176046b-966e-4f51-a63a-9d5bd69baa1f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:18.413838 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7176046b-966e-4f51-a63a-9d5bd69baa1f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:18.414642 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7176046b-966e-4f51-a63a-9d5bd69baa1f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:18.415080 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7176046b-966e-4f51-a63a-9d5bd69baa1f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:18.443491 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7176046b-966e-4f51-a63a-9d5bd69baa1f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042423 Jul 11 14:22:18.444047 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 426/841] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:22:18 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 11 14:22:18.501762 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5492d51e-c5d8-449c-889a-752b2a3c9ce9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:18.502317 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5492d51e-c5d8-449c-889a-752b2a3c9ce9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:18.509247 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5492d51e-c5d8-449c-889a-752b2a3c9ce9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:18.509698 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5492d51e-c5d8-449c-889a-752b2a3c9ce9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:18.510545 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5492d51e-c5d8-449c-889a-752b2a3c9ce9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:18.510990 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5492d51e-c5d8-449c-889a-752b2a3c9ce9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:18.515180 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:18.540144 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5492d51e-c5d8-449c-889a-752b2a3c9ce9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:22:18.615106 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5492d51e-c5d8-449c-889a-752b2a3c9ce9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "DELETE /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e" status: 204 len: 0 microversion: 2.1 time: 0.116912 Jul 11 14:22:18.615704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 416/842] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:22:18 2022] DELETE /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:22:18.624443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7808175b-4092-49dc-9ae5-6098b998b4d2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:18.625674 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7808175b-4092-49dc-9ae5-6098b998b4d2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:18.633955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7808175b-4092-49dc-9ae5-6098b998b4d2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:18.634439 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7808175b-4092-49dc-9ae5-6098b998b4d2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:18.635880 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7808175b-4092-49dc-9ae5-6098b998b4d2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:18.636365 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7808175b-4092-49dc-9ae5-6098b998b4d2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:18.772599 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7808175b-4092-49dc-9ae5-6098b998b4d2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:18.780274 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7808175b-4092-49dc-9ae5-6098b998b4d2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e" status: 200 len: 1684 microversion: 2.1 time: 0.159985 Jul 11 14:22:18.780855 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 427/843] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:18 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:19.798686 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-58eeba0b-d00a-45b9-ba6e-b65b3bfcaaba tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:19.799400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-58eeba0b-d00a-45b9-ba6e-b65b3bfcaaba tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:19.806636 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58eeba0b-d00a-45b9-ba6e-b65b3bfcaaba tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:19.807094 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58eeba0b-d00a-45b9-ba6e-b65b3bfcaaba tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:19.807866 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58eeba0b-d00a-45b9-ba6e-b65b3bfcaaba tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:19.808306 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58eeba0b-d00a-45b9-ba6e-b65b3bfcaaba tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:19.941970 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-58eeba0b-d00a-45b9-ba6e-b65b3bfcaaba tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:19.949962 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-58eeba0b-d00a-45b9-ba6e-b65b3bfcaaba tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e" status: 200 len: 1684 microversion: 2.1 time: 0.155735 Jul 11 14:22:19.950563 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 417/844] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:19 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:20.968137 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-66a7aae0-e8da-4047-9ded-b341d9fea01b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:20.968752 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-66a7aae0-e8da-4047-9ded-b341d9fea01b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:20.974685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-66a7aae0-e8da-4047-9ded-b341d9fea01b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:20.975135 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-66a7aae0-e8da-4047-9ded-b341d9fea01b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:20.975900 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-66a7aae0-e8da-4047-9ded-b341d9fea01b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:20.976981 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-66a7aae0-e8da-4047-9ded-b341d9fea01b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:21.204026 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-66a7aae0-e8da-4047-9ded-b341d9fea01b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:21.212505 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-66a7aae0-e8da-4047-9ded-b341d9fea01b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e" status: 200 len: 1684 microversion: 2.1 time: 0.248376 Jul 11 14:22:21.213311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 428/845] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:20 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e => generated 1684 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:21.440066 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-28553548-35b0-440b-b86a-a4d92eb3373a req-0b6760c6-e819-494f-b80a-198e42b17fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de5ec3b0-8851-4d21-a2ec-5a3e5487d73e", "name": "network-vif-deleted", "tag": "90500653-99cd-4737-b71c-792e2ce9a238"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:22:21.453560 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-28553548-35b0-440b-b86a-a4d92eb3373a req-0b6760c6-e819-494f-b80a-198e42b17fbf service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:21.454011 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-28553548-35b0-440b-b86a-a4d92eb3373a req-0b6760c6-e819-494f-b80a-198e42b17fbf service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:21.469367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-28553548-35b0-440b-b86a-a4d92eb3373a req-0b6760c6-e819-494f-b80a-198e42b17fbf service nova] Creating event network-vif-deleted:90500653-99cd-4737-b71c-792e2ce9a238 for instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e on hv-cinder-81914 Jul 11 14:22:21.475223 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-28553548-35b0-440b-b86a-a4d92eb3373a req-0b6760c6-e819-494f-b80a-198e42b17fbf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038704 Jul 11 14:22:21.477319 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 418/846] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:22:22.229459 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cf2fb1ce-7282-4195-bf10-61a7f0c191dc tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:22.230281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cf2fb1ce-7282-4195-bf10-61a7f0c191dc tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:22.237386 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf2fb1ce-7282-4195-bf10-61a7f0c191dc tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:22.237833 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf2fb1ce-7282-4195-bf10-61a7f0c191dc tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:22.238660 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf2fb1ce-7282-4195-bf10-61a7f0c191dc tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:22.239096 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf2fb1ce-7282-4195-bf10-61a7f0c191dc tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:22.254178 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-cf2fb1ce-7282-4195-bf10-61a7f0c191dc tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] HTTP exception thrown: Instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e could not be found. Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cf2fb1ce-7282-4195-bf10-61a7f0c191dc tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Request method failure captured: Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e HTTP/1.1 Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDGazgesZ8gm-xkGX3sogYiEnmE9DbvhKeeh7tJMTX6Y58vVTm48pJ0qqerjCEqeh3Rk7vIu5Mf6TPbuSudm7DddzzEsc9NjqbILyr7XHvKKA7DT_oLLVUIhEbYpW0g3TYtb5AJyNnSid_YkDT-vH95HrvzbM46bM90tJC5hswTE0Jw Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:22:22.256102 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:22:22.258543 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:22:22.258543 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:22:22.258543 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:22:22.258543 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:22:22.258543 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:22:22.258543 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:22:22.258543 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:22:22.258543 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 5bbea49c1a55481c9995f04f2e9b8618 Jul 11 14:22:22.258543 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:22:22.258543 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:22:22.258543 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e could not be found. Jul 11 14:22:22.258543 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': 'de5ec3b0-8851-4d21-a2ec-5a3e5487d73e'} Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e could not be found. Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:22:22.259469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:22:22.260948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:22:22.260948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:22:22.260948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:22:22.260948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:22:22.260948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:22:22.260948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:22:22.260948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:22:22.260948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e could not be found. Jul 11 14:22:22.260948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:22:22.260948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:22:22.260948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:22:22.260948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:22:22.260948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:22:22.260948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:22:22.260948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:22:22.260948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:22:22.260948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e could not be found. Jul 11 14:22:22.260948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:22:22.262279 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cf2fb1ce-7282-4195-bf10-61a7f0c191dc tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Returning 404 to user: Instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:22:22.262279 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cf2fb1ce-7282-4195-bf10-61a7f0c191dc tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e" status: 404 len: 111 microversion: 2.1 time: 0.032609 Jul 11 14:22:22.262454 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 429/847] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:22 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:22:22.268572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c0c033ff-9eb9-499a-a701-05cd6429f9f3 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '.version_select at 0x7fc976aa2160>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:22.287479 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c0c033ff-9eb9-499a-a701-05cd6429f9f3 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1236296007" status: 202 len: 0 microversion: 2.1 time: 0.023493 Jul 11 14:22:22.288321 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 419/848] 10.222.0.66 () {58 vars in 1220 bytes} [Mon Jul 11 14:22:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1236296007 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:22:22.919104 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dd1efe88-0964-41b5-9524-12f780d498e4 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Action: 'create', calling method: .version_select at 0x7fc976b3f4c0>, body: {"keypair": {"name": "tempest-keypair-938293597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsIK9m6bUpaKVTvqKwR/huWunBABD7O6XIIQz/OEyaZr6DWYGoydF77Cn1KHMCBBKP6+xGZCUlMXxfKvPWs0pUVRQNOqaPmZ3f7cQR/od8/1BjiMhIE304IiO1Uyu0G9Q=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:22:22.933368 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-dd1efe88-0964-41b5-9524-12f780d498e4 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Getting quotas for project 30c5e99c9761441fbad367a0bb8e1e66. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:22:22.937200 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-dd1efe88-0964-41b5-9524-12f780d498e4 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Getting quotas for user 5bbea49c1a55481c9995f04f2e9b8618 and project 30c5e99c9761441fbad367a0bb8e1e66. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:22:22.961446 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dd1efe88-0964-41b5-9524-12f780d498e4 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045524 Jul 11 14:22:22.962186 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 430/849] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 11 14:22:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:22:24.906270 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4917aba3-2a6a-4d76-ac10-9c0e2656a97e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-885115509", "imageRef": "67874ac7-fac8-4d6d-9cd1-9091ecb957b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "082c1f0c-e3fc-4cfb-9f28-88c9d2f15bb4"}], "security_groups": [{"name": "tempest-securitygroup--109030950"}], "key_name": "tempest-keypair-938293597", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:22:24.913588 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:25.011887 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-4917aba3-2a6a-4d76-ac10-9c0e2656a97e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] validate_networks() for [('082c1f0c-e3fc-4cfb-9f28-88c9d2f15bb4', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:22:25.386879 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-4917aba3-2a6a-4d76-ac10-9c0e2656a97e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:22:25.387297 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-4917aba3-2a6a-4d76-ac10-9c0e2656a97e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:22:25.387795 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-4917aba3-2a6a-4d76-ac10-9c0e2656a97e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:22:25.388196 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-4917aba3-2a6a-4d76-ac10-9c0e2656a97e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:22:25.388597 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-4917aba3-2a6a-4d76-ac10-9c0e2656a97e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:22:25.397455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4917aba3-2a6a-4d76-ac10-9c0e2656a97e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:25.398798 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4917aba3-2a6a-4d76-ac10-9c0e2656a97e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:25.399613 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4917aba3-2a6a-4d76-ac10-9c0e2656a97e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:25.400050 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4917aba3-2a6a-4d76-ac10-9c0e2656a97e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:25.416853 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-4917aba3-2a6a-4d76-ac10-9c0e2656a97e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Getting quotas for project 30c5e99c9761441fbad367a0bb8e1e66. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:22:25.420844 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-4917aba3-2a6a-4d76-ac10-9c0e2656a97e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Getting quotas for user 5bbea49c1a55481c9995f04f2e9b8618 and project 30c5e99c9761441fbad367a0bb8e1e66. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:22:25.432361 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4917aba3-2a6a-4d76-ac10-9c0e2656a97e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:22:25.434738 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4917aba3-2a6a-4d76-ac10-9c0e2656a97e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67874ac7-fac8-4d6d-9cd1-9091ecb957b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:22:25.481637 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4917aba3-2a6a-4d76-ac10-9c0e2656a97e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.580550 Jul 11 14:22:25.482315 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 420/850] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:22:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:22:25.493779 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-284a460e-e9bf-4a6f-829b-3b1f758448ec tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:25.494618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-284a460e-e9bf-4a6f-829b-3b1f758448ec tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:25.548347 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-284a460e-e9bf-4a6f-829b-3b1f758448ec tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:25.557197 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-284a460e-e9bf-4a6f-829b-3b1f758448ec tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 200 len: 1240 microversion: 2.1 time: 0.068474 Jul 11 14:22:25.557776 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 431/851] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:25 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:26.576052 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-330b731d-5803-4565-8042-5cd92626e074 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:26.577168 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-330b731d-5803-4565-8042-5cd92626e074 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:26.584940 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-330b731d-5803-4565-8042-5cd92626e074 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:26.586010 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-330b731d-5803-4565-8042-5cd92626e074 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:26.586957 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-330b731d-5803-4565-8042-5cd92626e074 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:26.587605 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-330b731d-5803-4565-8042-5cd92626e074 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:26.658125 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-330b731d-5803-4565-8042-5cd92626e074 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:26.665698 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-330b731d-5803-4565-8042-5cd92626e074 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 200 len: 1310 microversion: 2.1 time: 0.094130 Jul 11 14:22:26.666380 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 421/852] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:26 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 1310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:27.683511 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-89ee441b-3a65-4314-a0d1-8c56a74d7322 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:27.684128 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-89ee441b-3a65-4314-a0d1-8c56a74d7322 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:27.690125 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89ee441b-3a65-4314-a0d1-8c56a74d7322 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:27.690605 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89ee441b-3a65-4314-a0d1-8c56a74d7322 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:27.691393 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89ee441b-3a65-4314-a0d1-8c56a74d7322 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:27.691830 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89ee441b-3a65-4314-a0d1-8c56a74d7322 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:27.899925 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-89ee441b-3a65-4314-a0d1-8c56a74d7322 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:27.909130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-89ee441b-3a65-4314-a0d1-8c56a74d7322 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 200 len: 1365 microversion: 2.1 time: 0.230452 Jul 11 14:22:27.909714 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 432/853] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:27 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:28.115912 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-2fbe3daf-b5cc-4a5b-b962-32c5c6b7ef28 req-b2e1f134-eb18-4ef5-baa1-95713715b666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f166a5e8-f81d-4879-aa18-19c8cf86cd44", "tag": "8d5ba811-4eec-40ce-8da7-b9d5833c170b"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:22:28.126862 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-2fbe3daf-b5cc-4a5b-b962-32c5c6b7ef28 req-b2e1f134-eb18-4ef5-baa1-95713715b666 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:28.127703 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-2fbe3daf-b5cc-4a5b-b962-32c5c6b7ef28 req-b2e1f134-eb18-4ef5-baa1-95713715b666 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:28.139248 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-2fbe3daf-b5cc-4a5b-b962-32c5c6b7ef28 req-b2e1f134-eb18-4ef5-baa1-95713715b666 service nova] Creating event network-changed:8d5ba811-4eec-40ce-8da7-b9d5833c170b for instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 on hv-cinder-81914 Jul 11 14:22:28.144136 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-2fbe3daf-b5cc-4a5b-b962-32c5c6b7ef28 req-b2e1f134-eb18-4ef5-baa1-95713715b666 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031841 Jul 11 14:22:28.144738 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 422/854] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:22:28.926044 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-74ae6ded-2ee0-42d8-932f-61293259407c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:28.926697 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-74ae6ded-2ee0-42d8-932f-61293259407c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:28.933325 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74ae6ded-2ee0-42d8-932f-61293259407c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:28.933766 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74ae6ded-2ee0-42d8-932f-61293259407c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:28.934568 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74ae6ded-2ee0-42d8-932f-61293259407c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:28.935007 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74ae6ded-2ee0-42d8-932f-61293259407c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:29.072858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-74ae6ded-2ee0-42d8-932f-61293259407c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:29.080569 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-74ae6ded-2ee0-42d8-932f-61293259407c tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 200 len: 1365 microversion: 2.1 time: 0.158346 Jul 11 14:22:29.081156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 433/855] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:28 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:30.099335 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c52278e4-6d73-4670-953a-a52502f0d691 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:30.100130 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c52278e4-6d73-4670-953a-a52502f0d691 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:30.107880 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c52278e4-6d73-4670-953a-a52502f0d691 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:30.108365 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c52278e4-6d73-4670-953a-a52502f0d691 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:30.109140 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c52278e4-6d73-4670-953a-a52502f0d691 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:30.109578 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c52278e4-6d73-4670-953a-a52502f0d691 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:30.241908 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c52278e4-6d73-4670-953a-a52502f0d691 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:30.249669 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c52278e4-6d73-4670-953a-a52502f0d691 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 200 len: 1365 microversion: 2.1 time: 0.155134 Jul 11 14:22:30.250251 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 423/856] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:30 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:31.267430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ab94dbaa-0948-4ade-8242-10d0ed20266e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:31.268032 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ab94dbaa-0948-4ade-8242-10d0ed20266e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:31.275457 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab94dbaa-0948-4ade-8242-10d0ed20266e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:31.275911 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab94dbaa-0948-4ade-8242-10d0ed20266e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:31.276687 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab94dbaa-0948-4ade-8242-10d0ed20266e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:31.277126 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab94dbaa-0948-4ade-8242-10d0ed20266e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:31.409016 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ab94dbaa-0948-4ade-8242-10d0ed20266e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:31.416599 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ab94dbaa-0948-4ade-8242-10d0ed20266e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 200 len: 1365 microversion: 2.1 time: 0.153235 Jul 11 14:22:31.417166 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 434/857] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:31 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:32.433465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-20770f7c-eddf-412c-b6d8-9d83cc4c0c42 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:32.434082 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-20770f7c-eddf-412c-b6d8-9d83cc4c0c42 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:32.440644 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20770f7c-eddf-412c-b6d8-9d83cc4c0c42 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:32.441135 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20770f7c-eddf-412c-b6d8-9d83cc4c0c42 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:32.441899 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20770f7c-eddf-412c-b6d8-9d83cc4c0c42 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:32.442369 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20770f7c-eddf-412c-b6d8-9d83cc4c0c42 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:32.577995 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-20770f7c-eddf-412c-b6d8-9d83cc4c0c42 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:32.585603 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-20770f7c-eddf-412c-b6d8-9d83cc4c0c42 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 200 len: 1365 microversion: 2.1 time: 0.155991 Jul 11 14:22:32.586199 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 424/858] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:32 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:33.603187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-00e8e5e9-17c1-45ed-9c8e-05e1bdb584ee tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:33.603713 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-00e8e5e9-17c1-45ed-9c8e-05e1bdb584ee tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:33.606141 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:33.611536 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00e8e5e9-17c1-45ed-9c8e-05e1bdb584ee tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:33.612022 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00e8e5e9-17c1-45ed-9c8e-05e1bdb584ee tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:33.612797 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00e8e5e9-17c1-45ed-9c8e-05e1bdb584ee tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:33.613239 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00e8e5e9-17c1-45ed-9c8e-05e1bdb584ee tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:33.749533 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-00e8e5e9-17c1-45ed-9c8e-05e1bdb584ee tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:33.758429 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-00e8e5e9-17c1-45ed-9c8e-05e1bdb584ee tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 200 len: 1365 microversion: 2.1 time: 0.158692 Jul 11 14:22:33.758429 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 435/859] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:33 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:34.227639 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-a4aea585-2a3c-4ba6-b7d6-6e7da6b84d5a req-cbe59ad3-52a0-4780-88e6-2087781c91ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f166a5e8-f81d-4879-aa18-19c8cf86cd44", "name": "network-vif-plugged", "status": "completed", "tag": "8d5ba811-4eec-40ce-8da7-b9d5833c170b"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:22:34.236244 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-a4aea585-2a3c-4ba6-b7d6-6e7da6b84d5a req-cbe59ad3-52a0-4780-88e6-2087781c91ae service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:34.236626 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-a4aea585-2a3c-4ba6-b7d6-6e7da6b84d5a req-cbe59ad3-52a0-4780-88e6-2087781c91ae service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:34.249765 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-a4aea585-2a3c-4ba6-b7d6-6e7da6b84d5a req-cbe59ad3-52a0-4780-88e6-2087781c91ae service nova] Creating event network-vif-plugged:8d5ba811-4eec-40ce-8da7-b9d5833c170b for instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 on hv-cinder-81914 Jul 11 14:22:34.254742 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-a4aea585-2a3c-4ba6-b7d6-6e7da6b84d5a req-cbe59ad3-52a0-4780-88e6-2087781c91ae service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031130 Jul 11 14:22:34.255582 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 425/860] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:22:34.774326 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b419845f-b6fd-4665-8318-264a682b8279 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:34.774888 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b419845f-b6fd-4665-8318-264a682b8279 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:34.781319 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b419845f-b6fd-4665-8318-264a682b8279 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:34.781770 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b419845f-b6fd-4665-8318-264a682b8279 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:34.782580 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b419845f-b6fd-4665-8318-264a682b8279 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:34.783019 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b419845f-b6fd-4665-8318-264a682b8279 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:34.919706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b419845f-b6fd-4665-8318-264a682b8279 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:34.927205 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b419845f-b6fd-4665-8318-264a682b8279 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 200 len: 1365 microversion: 2.1 time: 0.156978 Jul 11 14:22:34.927786 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 436/861] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:34 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:35.946289 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b211054f-0576-4101-93b1-6c89846d98e7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:35.946985 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b211054f-0576-4101-93b1-6c89846d98e7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:35.949398 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:35.950043 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:35.956769 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b211054f-0576-4101-93b1-6c89846d98e7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:35.957209 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b211054f-0576-4101-93b1-6c89846d98e7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:35.958135 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b211054f-0576-4101-93b1-6c89846d98e7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:35.958591 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b211054f-0576-4101-93b1-6c89846d98e7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:36.107473 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b211054f-0576-4101-93b1-6c89846d98e7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:36.114969 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b211054f-0576-4101-93b1-6c89846d98e7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 200 len: 1365 microversion: 2.1 time: 0.174417 Jul 11 14:22:36.115551 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 426/862] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:35 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:22:37.133614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c50b14d7-b552-4ed8-90b2-23b93596755b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:37.134280 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c50b14d7-b552-4ed8-90b2-23b93596755b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:37.136051 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:37.142107 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c50b14d7-b552-4ed8-90b2-23b93596755b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:37.142581 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c50b14d7-b552-4ed8-90b2-23b93596755b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:37.143357 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c50b14d7-b552-4ed8-90b2-23b93596755b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:37.143790 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c50b14d7-b552-4ed8-90b2-23b93596755b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:37.275163 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c50b14d7-b552-4ed8-90b2-23b93596755b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:37.282724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c50b14d7-b552-4ed8-90b2-23b93596755b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 200 len: 1555 microversion: 2.1 time: 0.153741 Jul 11 14:22:37.283288 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 437/863] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:37 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:37.299029 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4242ca79-01b2-4c61-9a95-94c4e9dbb38d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:37.299574 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4242ca79-01b2-4c61-9a95-94c4e9dbb38d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:37.306175 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4242ca79-01b2-4c61-9a95-94c4e9dbb38d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:37.306634 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4242ca79-01b2-4c61-9a95-94c4e9dbb38d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:37.307406 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4242ca79-01b2-4c61-9a95-94c4e9dbb38d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:37.307843 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4242ca79-01b2-4c61-9a95-94c4e9dbb38d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:37.391180 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4242ca79-01b2-4c61-9a95-94c4e9dbb38d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095969 Jul 11 14:22:37.391793 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 427/864] 10.222.0.66 () {58 vars in 1274 bytes} [Mon Jul 11 14:22:37 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:22:38.337160 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-788c2490-b017-482c-a970-bc7f59d8a59f req-cd52c7ad-8dbb-43ec-986a-86adeee587c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f166a5e8-f81d-4879-aa18-19c8cf86cd44", "tag": "8d5ba811-4eec-40ce-8da7-b9d5833c170b"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:22:38.345893 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-788c2490-b017-482c-a970-bc7f59d8a59f req-cd52c7ad-8dbb-43ec-986a-86adeee587c4 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:38.346372 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-788c2490-b017-482c-a970-bc7f59d8a59f req-cd52c7ad-8dbb-43ec-986a-86adeee587c4 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:38.360682 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-788c2490-b017-482c-a970-bc7f59d8a59f req-cd52c7ad-8dbb-43ec-986a-86adeee587c4 service nova] Creating event network-changed:8d5ba811-4eec-40ce-8da7-b9d5833c170b for instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 on hv-cinder-81914 Jul 11 14:22:38.366028 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-788c2490-b017-482c-a970-bc7f59d8a59f req-cd52c7ad-8dbb-43ec-986a-86adeee587c4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033190 Jul 11 14:22:38.366937 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 438/865] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:22:49.931039 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:49.931798 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:49.936512 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-123974b0-d2e4-4d21-adab-30e6b7458eef tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:49.937007 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-123974b0-d2e4-4d21-adab-30e6b7458eef tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:49.945554 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-123974b0-d2e4-4d21-adab-30e6b7458eef tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:49.946266 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-123974b0-d2e4-4d21-adab-30e6b7458eef tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:49.947178 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-123974b0-d2e4-4d21-adab-30e6b7458eef tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:49.947787 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-123974b0-d2e4-4d21-adab-30e6b7458eef tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:50.121527 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-123974b0-d2e4-4d21-adab-30e6b7458eef tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa/ips" status: 200 len: 152 microversion: 2.20 time: 0.192102 Jul 11 14:22:50.122117 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 428/866] 10.222.0.66 () {60 vars in 1288 bytes} [Mon Jul 11 14:22:49 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa/ips => generated 152 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:22:51.905602 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=7 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:51.906380 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:51.911217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b3cf499c-a6ec-4810-bfa6-7da761d8660c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:22:51.912448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b3cf499c-a6ec-4810-bfa6-7da761d8660c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:51.920648 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3cf499c-a6ec-4810-bfa6-7da761d8660c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:51.921096 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3cf499c-a6ec-4810-bfa6-7da761d8660c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:51.921865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3cf499c-a6ec-4810-bfa6-7da761d8660c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:51.922330 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3cf499c-a6ec-4810-bfa6-7da761d8660c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:51.945514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-b3cf499c-a6ec-4810-bfa6-7da761d8660c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lazy-loading 'flavor' on Instance uuid 5a20f292-9867-4b58-a3eb-12f153edd3aa {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:22:52.248564 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b3cf499c-a6ec-4810-bfa6-7da761d8660c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "POST /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa/action" status: 202 len: 0 microversion: 2.20 time: 0.344379 Jul 11 14:22:52.249398 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 439/867] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Jul 11 14:22:51 2022] POST /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:22:52.258366 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6452155d-8c73-4f8a-816c-cad396c4cd0e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:52.259002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6452155d-8c73-4f8a-816c-cad396c4cd0e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:52.265366 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6452155d-8c73-4f8a-816c-cad396c4cd0e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:52.265817 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6452155d-8c73-4f8a-816c-cad396c4cd0e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:52.266633 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6452155d-8c73-4f8a-816c-cad396c4cd0e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:52.267064 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6452155d-8c73-4f8a-816c-cad396c4cd0e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:52.405849 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6452155d-8c73-4f8a-816c-cad396c4cd0e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:52.414042 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6452155d-8c73-4f8a-816c-cad396c4cd0e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:52.415594 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6452155d-8c73-4f8a-816c-cad396c4cd0e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:52.416771 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6452155d-8c73-4f8a-816c-cad396c4cd0e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1725 microversion: 2.20 time: 0.163098 Jul 11 14:22:52.417377 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 429/868] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:22:52 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:22:53.436897 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b951e484-4282-48fb-a01c-fa1d4dde1c41 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:53.437603 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b951e484-4282-48fb-a01c-fa1d4dde1c41 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:53.445502 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b951e484-4282-48fb-a01c-fa1d4dde1c41 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:53.445955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b951e484-4282-48fb-a01c-fa1d4dde1c41 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:53.446776 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b951e484-4282-48fb-a01c-fa1d4dde1c41 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:53.447211 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b951e484-4282-48fb-a01c-fa1d4dde1c41 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:53.577306 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b951e484-4282-48fb-a01c-fa1d4dde1c41 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:53.585593 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b951e484-4282-48fb-a01c-fa1d4dde1c41 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:53.587147 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b951e484-4282-48fb-a01c-fa1d4dde1c41 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:53.588328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b951e484-4282-48fb-a01c-fa1d4dde1c41 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1725 microversion: 2.20 time: 0.156328 Jul 11 14:22:53.588887 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 440/869] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:22:53 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:22:54.607455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fba000c5-fcbf-4650-9743-ac0afe0257a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:54.608037 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fba000c5-fcbf-4650-9743-ac0afe0257a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:54.614191 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fba000c5-fcbf-4650-9743-ac0afe0257a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:54.615299 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fba000c5-fcbf-4650-9743-ac0afe0257a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:54.616091 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fba000c5-fcbf-4650-9743-ac0afe0257a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:54.616527 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fba000c5-fcbf-4650-9743-ac0afe0257a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:54.759711 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fba000c5-fcbf-4650-9743-ac0afe0257a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:54.767703 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fba000c5-fcbf-4650-9743-ac0afe0257a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:54.769204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fba000c5-fcbf-4650-9743-ac0afe0257a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:54.770408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fba000c5-fcbf-4650-9743-ac0afe0257a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1725 microversion: 2.20 time: 0.167031 Jul 11 14:22:54.771091 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 430/870] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:22:54 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:22:55.789499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fddefff6-d910-474b-91ad-a5cdd3c75673 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:55.790123 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fddefff6-d910-474b-91ad-a5cdd3c75673 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:55.796657 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fddefff6-d910-474b-91ad-a5cdd3c75673 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:55.797104 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fddefff6-d910-474b-91ad-a5cdd3c75673 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:55.797866 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fddefff6-d910-474b-91ad-a5cdd3c75673 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:55.798344 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fddefff6-d910-474b-91ad-a5cdd3c75673 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:55.935360 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fddefff6-d910-474b-91ad-a5cdd3c75673 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:55.943841 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fddefff6-d910-474b-91ad-a5cdd3c75673 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:55.945495 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fddefff6-d910-474b-91ad-a5cdd3c75673 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:55.946765 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fddefff6-d910-474b-91ad-a5cdd3c75673 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1725 microversion: 2.20 time: 0.161817 Jul 11 14:22:55.947332 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 441/871] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:22:55 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:22:56.964982 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0539b5d5-9be0-4f91-84ad-578d0f04bcdd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:56.965578 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0539b5d5-9be0-4f91-84ad-578d0f04bcdd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:56.972099 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0539b5d5-9be0-4f91-84ad-578d0f04bcdd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:56.972546 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0539b5d5-9be0-4f91-84ad-578d0f04bcdd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:56.973314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0539b5d5-9be0-4f91-84ad-578d0f04bcdd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:56.973748 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0539b5d5-9be0-4f91-84ad-578d0f04bcdd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:57.107140 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0539b5d5-9be0-4f91-84ad-578d0f04bcdd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:57.115179 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0539b5d5-9be0-4f91-84ad-578d0f04bcdd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:57.116693 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0539b5d5-9be0-4f91-84ad-578d0f04bcdd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:57.117851 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0539b5d5-9be0-4f91-84ad-578d0f04bcdd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1725 microversion: 2.20 time: 0.156810 Jul 11 14:22:57.118455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 431/872] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:22:56 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:22:58.136499 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8e97a16a-75df-4046-92a2-8dedaec2b594 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:58.137080 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8e97a16a-75df-4046-92a2-8dedaec2b594 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:58.143630 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e97a16a-75df-4046-92a2-8dedaec2b594 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:58.144079 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e97a16a-75df-4046-92a2-8dedaec2b594 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:58.144850 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e97a16a-75df-4046-92a2-8dedaec2b594 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:58.145320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e97a16a-75df-4046-92a2-8dedaec2b594 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:58.274194 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8e97a16a-75df-4046-92a2-8dedaec2b594 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:58.282431 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8e97a16a-75df-4046-92a2-8dedaec2b594 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:58.283960 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8e97a16a-75df-4046-92a2-8dedaec2b594 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:58.285129 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8e97a16a-75df-4046-92a2-8dedaec2b594 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1725 microversion: 2.20 time: 0.152662 Jul 11 14:22:58.285709 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 442/873] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:22:58 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:22:59.304966 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-93b3ba3c-7c50-4e32-a047-2142fcc8c6dd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:59.305564 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-93b3ba3c-7c50-4e32-a047-2142fcc8c6dd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:59.312242 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-93b3ba3c-7c50-4e32-a047-2142fcc8c6dd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:59.312679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-93b3ba3c-7c50-4e32-a047-2142fcc8c6dd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:59.313515 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-93b3ba3c-7c50-4e32-a047-2142fcc8c6dd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:59.313941 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-93b3ba3c-7c50-4e32-a047-2142fcc8c6dd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:59.459182 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-93b3ba3c-7c50-4e32-a047-2142fcc8c6dd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:59.467513 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-93b3ba3c-7c50-4e32-a047-2142fcc8c6dd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:59.469018 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-93b3ba3c-7c50-4e32-a047-2142fcc8c6dd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:59.470223 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-93b3ba3c-7c50-4e32-a047-2142fcc8c6dd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1725 microversion: 2.20 time: 0.169724 Jul 11 14:22:59.470800 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 432/874] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:22:59 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:00.496504 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dfa5dd37-9bd3-4da5-8dd9-158c4040bc6e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:00.497092 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dfa5dd37-9bd3-4da5-8dd9-158c4040bc6e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:00.503748 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfa5dd37-9bd3-4da5-8dd9-158c4040bc6e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:00.504203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfa5dd37-9bd3-4da5-8dd9-158c4040bc6e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:00.504979 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfa5dd37-9bd3-4da5-8dd9-158c4040bc6e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:00.505415 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfa5dd37-9bd3-4da5-8dd9-158c4040bc6e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:00.642899 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dfa5dd37-9bd3-4da5-8dd9-158c4040bc6e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:00.651629 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dfa5dd37-9bd3-4da5-8dd9-158c4040bc6e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:00.653136 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dfa5dd37-9bd3-4da5-8dd9-158c4040bc6e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:00.654343 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dfa5dd37-9bd3-4da5-8dd9-158c4040bc6e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1725 microversion: 2.20 time: 0.162139 Jul 11 14:23:00.654911 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 443/875] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:00 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:23:01.672636 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-94b5351d-8f0a-416e-b07a-858fc15c357a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:01.673277 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-94b5351d-8f0a-416e-b07a-858fc15c357a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:01.680190 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-94b5351d-8f0a-416e-b07a-858fc15c357a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:01.680637 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-94b5351d-8f0a-416e-b07a-858fc15c357a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:01.681407 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-94b5351d-8f0a-416e-b07a-858fc15c357a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:01.681846 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-94b5351d-8f0a-416e-b07a-858fc15c357a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:01.813214 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-94b5351d-8f0a-416e-b07a-858fc15c357a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:01.821744 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-94b5351d-8f0a-416e-b07a-858fc15c357a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:01.823298 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-94b5351d-8f0a-416e-b07a-858fc15c357a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:01.824480 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-94b5351d-8f0a-416e-b07a-858fc15c357a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1725 microversion: 2.20 time: 0.155909 Jul 11 14:23:01.825045 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 433/876] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:01 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:02.843412 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6124f3bc-c04c-4183-9708-930fe55badb2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:02.844026 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6124f3bc-c04c-4183-9708-930fe55badb2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:02.851364 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6124f3bc-c04c-4183-9708-930fe55badb2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:02.851817 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6124f3bc-c04c-4183-9708-930fe55badb2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:02.852597 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6124f3bc-c04c-4183-9708-930fe55badb2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:02.853035 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6124f3bc-c04c-4183-9708-930fe55badb2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:02.983299 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6124f3bc-c04c-4183-9708-930fe55badb2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:02.991496 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6124f3bc-c04c-4183-9708-930fe55badb2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:02.993024 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6124f3bc-c04c-4183-9708-930fe55badb2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:02.994515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6124f3bc-c04c-4183-9708-930fe55badb2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1725 microversion: 2.20 time: 0.154790 Jul 11 14:23:02.995084 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 444/877] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:02 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:04.012988 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-76274e3a-fad7-48c4-8659-406688101637 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:04.013598 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-76274e3a-fad7-48c4-8659-406688101637 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:04.020168 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-76274e3a-fad7-48c4-8659-406688101637 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:04.020634 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-76274e3a-fad7-48c4-8659-406688101637 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:04.021466 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-76274e3a-fad7-48c4-8659-406688101637 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:04.022066 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-76274e3a-fad7-48c4-8659-406688101637 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:04.156700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-76274e3a-fad7-48c4-8659-406688101637 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:04.165130 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-76274e3a-fad7-48c4-8659-406688101637 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:04.166661 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-76274e3a-fad7-48c4-8659-406688101637 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:04.167812 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-76274e3a-fad7-48c4-8659-406688101637 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1725 microversion: 2.20 time: 0.158831 Jul 11 14:23:04.168372 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 434/878] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:04 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:05.187010 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fcf01995-768a-4cac-8745-221b63f294e2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:05.187633 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fcf01995-768a-4cac-8745-221b63f294e2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:05.194611 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcf01995-768a-4cac-8745-221b63f294e2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:05.195060 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcf01995-768a-4cac-8745-221b63f294e2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:05.195830 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcf01995-768a-4cac-8745-221b63f294e2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:05.196271 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcf01995-768a-4cac-8745-221b63f294e2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:05.325634 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fcf01995-768a-4cac-8745-221b63f294e2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:05.334203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fcf01995-768a-4cac-8745-221b63f294e2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:05.335842 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fcf01995-768a-4cac-8745-221b63f294e2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:05.337017 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fcf01995-768a-4cac-8745-221b63f294e2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1725 microversion: 2.20 time: 0.154001 Jul 11 14:23:05.337594 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 445/879] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:05 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:06.356279 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4ef19874-2b4a-47b9-b696-263a040e19aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:06.356927 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4ef19874-2b4a-47b9-b696-263a040e19aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:06.363573 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef19874-2b4a-47b9-b696-263a040e19aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:06.364025 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef19874-2b4a-47b9-b696-263a040e19aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:06.365433 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef19874-2b4a-47b9-b696-263a040e19aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:06.366049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef19874-2b4a-47b9-b696-263a040e19aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:06.499729 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4ef19874-2b4a-47b9-b696-263a040e19aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:06.507974 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4ef19874-2b4a-47b9-b696-263a040e19aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:06.509498 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4ef19874-2b4a-47b9-b696-263a040e19aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:06.510698 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4ef19874-2b4a-47b9-b696-263a040e19aa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1725 microversion: 2.20 time: 0.158402 Jul 11 14:23:06.511266 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 435/880] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:06 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:07.530603 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb5f2e79-1cbd-4274-9062-736de722a5cd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:07.531138 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cb5f2e79-1cbd-4274-9062-736de722a5cd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:07.537651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb5f2e79-1cbd-4274-9062-736de722a5cd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:07.538098 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb5f2e79-1cbd-4274-9062-736de722a5cd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:07.538894 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb5f2e79-1cbd-4274-9062-736de722a5cd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:07.539327 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb5f2e79-1cbd-4274-9062-736de722a5cd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:07.671754 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb5f2e79-1cbd-4274-9062-736de722a5cd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:07.680246 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb5f2e79-1cbd-4274-9062-736de722a5cd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:07.681782 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb5f2e79-1cbd-4274-9062-736de722a5cd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:07.682987 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cb5f2e79-1cbd-4274-9062-736de722a5cd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1725 microversion: 2.20 time: 0.156416 Jul 11 14:23:07.683559 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 446/881] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:07 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:08.701084 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ef249745-6100-4715-9a6e-6eb366fd0216 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:08.701693 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ef249745-6100-4715-9a6e-6eb366fd0216 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:08.708235 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef249745-6100-4715-9a6e-6eb366fd0216 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:08.709664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef249745-6100-4715-9a6e-6eb366fd0216 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:08.710464 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef249745-6100-4715-9a6e-6eb366fd0216 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:08.710903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef249745-6100-4715-9a6e-6eb366fd0216 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:08.840065 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ef249745-6100-4715-9a6e-6eb366fd0216 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:08.851079 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ef249745-6100-4715-9a6e-6eb366fd0216 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:08.852597 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ef249745-6100-4715-9a6e-6eb366fd0216 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:08.853761 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ef249745-6100-4715-9a6e-6eb366fd0216 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1746 microversion: 2.20 time: 0.156708 Jul 11 14:23:08.854349 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 436/882] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:08 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:09.873491 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7564330d-364d-4d83-be21-f46c724e1631 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:09.874097 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7564330d-364d-4d83-be21-f46c724e1631 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:09.881335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7564330d-364d-4d83-be21-f46c724e1631 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:09.881884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7564330d-364d-4d83-be21-f46c724e1631 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:09.882674 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7564330d-364d-4d83-be21-f46c724e1631 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:09.883104 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7564330d-364d-4d83-be21-f46c724e1631 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:10.016436 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7564330d-364d-4d83-be21-f46c724e1631 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:10.025446 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7564330d-364d-4d83-be21-f46c724e1631 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:10.026947 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7564330d-364d-4d83-be21-f46c724e1631 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:10.028125 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7564330d-364d-4d83-be21-f46c724e1631 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1746 microversion: 2.20 time: 0.158594 Jul 11 14:23:10.028698 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 447/883] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:09 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:11.045462 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-aa5adabe-32a9-4f50-8e39-330c7c02cd6d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:11.046128 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-aa5adabe-32a9-4f50-8e39-330c7c02cd6d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:11.053555 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aa5adabe-32a9-4f50-8e39-330c7c02cd6d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:11.054421 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aa5adabe-32a9-4f50-8e39-330c7c02cd6d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:11.055893 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aa5adabe-32a9-4f50-8e39-330c7c02cd6d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:11.056499 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aa5adabe-32a9-4f50-8e39-330c7c02cd6d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:11.220628 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-aa5adabe-32a9-4f50-8e39-330c7c02cd6d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:11.229399 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-aa5adabe-32a9-4f50-8e39-330c7c02cd6d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:11.230932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-aa5adabe-32a9-4f50-8e39-330c7c02cd6d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:11.232333 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-aa5adabe-32a9-4f50-8e39-330c7c02cd6d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1741 microversion: 2.20 time: 0.190755 Jul 11 14:23:11.232889 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 437/884] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:11 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:12.251031 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ed407f36-68d5-4a3b-867e-d6667cc62b97 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:12.252287 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ed407f36-68d5-4a3b-867e-d6667cc62b97 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:12.262306 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed407f36-68d5-4a3b-867e-d6667cc62b97 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:12.262968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed407f36-68d5-4a3b-867e-d6667cc62b97 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:12.264151 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed407f36-68d5-4a3b-867e-d6667cc62b97 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:12.264754 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed407f36-68d5-4a3b-867e-d6667cc62b97 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:12.437124 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ed407f36-68d5-4a3b-867e-d6667cc62b97 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:12.448578 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ed407f36-68d5-4a3b-867e-d6667cc62b97 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:12.450129 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ed407f36-68d5-4a3b-867e-d6667cc62b97 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:12.451381 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ed407f36-68d5-4a3b-867e-d6667cc62b97 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1741 microversion: 2.20 time: 0.204250 Jul 11 14:23:12.451968 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 448/885] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:12 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:12.467766 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-911e41c4-0305-42d5-95fb-f40089ef9e8e req-3be65aa7-5b17-49ee-ae80-0f2c135f1133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a20f292-9867-4b58-a3eb-12f153edd3aa", "name": "network-vif-plugged", "status": "completed", "tag": "802d4a9e-0fa0-41e8-876a-385488fc4283"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:23:12.486668 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-911e41c4-0305-42d5-95fb-f40089ef9e8e req-3be65aa7-5b17-49ee-ae80-0f2c135f1133 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:12.487527 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-911e41c4-0305-42d5-95fb-f40089ef9e8e req-3be65aa7-5b17-49ee-ae80-0f2c135f1133 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:12.503586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-911e41c4-0305-42d5-95fb-f40089ef9e8e req-3be65aa7-5b17-49ee-ae80-0f2c135f1133 service nova] Creating event network-vif-plugged:802d4a9e-0fa0-41e8-876a-385488fc4283 for instance 5a20f292-9867-4b58-a3eb-12f153edd3aa on hv-cinder-81914 Jul 11 14:23:12.510924 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-911e41c4-0305-42d5-95fb-f40089ef9e8e req-3be65aa7-5b17-49ee-ae80-0f2c135f1133 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046171 Jul 11 14:23:12.511858 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 438/886] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:23:13.470455 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-85ff5d41-748a-46dd-b7e2-f5eeb122e0c8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:13.471030 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-85ff5d41-748a-46dd-b7e2-f5eeb122e0c8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:13.479437 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85ff5d41-748a-46dd-b7e2-f5eeb122e0c8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:13.479882 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85ff5d41-748a-46dd-b7e2-f5eeb122e0c8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:13.480676 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85ff5d41-748a-46dd-b7e2-f5eeb122e0c8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:13.481114 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85ff5d41-748a-46dd-b7e2-f5eeb122e0c8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:13.640007 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-85ff5d41-748a-46dd-b7e2-f5eeb122e0c8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:13.648848 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-85ff5d41-748a-46dd-b7e2-f5eeb122e0c8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:13.652251 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-85ff5d41-748a-46dd-b7e2-f5eeb122e0c8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:13.652591 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-85ff5d41-748a-46dd-b7e2-f5eeb122e0c8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1741 microversion: 2.20 time: 0.186124 Jul 11 14:23:13.654179 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 449/887] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:13 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:23:14.677398 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-68796082-928b-4838-957c-2cb853787a61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:14.678739 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-68796082-928b-4838-957c-2cb853787a61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:14.685689 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-68796082-928b-4838-957c-2cb853787a61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:14.686180 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-68796082-928b-4838-957c-2cb853787a61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:14.686946 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-68796082-928b-4838-957c-2cb853787a61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:14.687373 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-68796082-928b-4838-957c-2cb853787a61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:14.847342 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-68796082-928b-4838-957c-2cb853787a61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:14.858352 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-68796082-928b-4838-957c-2cb853787a61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:14.858786 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-68796082-928b-4838-957c-2cb853787a61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:14.859952 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-68796082-928b-4838-957c-2cb853787a61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1741 microversion: 2.20 time: 0.191087 Jul 11 14:23:14.860505 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 439/888] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:14 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:15.880901 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-13cf108b-7add-44cb-94a5-ad155cbcca86 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:15.881825 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-13cf108b-7add-44cb-94a5-ad155cbcca86 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:15.888191 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13cf108b-7add-44cb-94a5-ad155cbcca86 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:15.889336 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13cf108b-7add-44cb-94a5-ad155cbcca86 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:15.889647 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13cf108b-7add-44cb-94a5-ad155cbcca86 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:15.889928 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13cf108b-7add-44cb-94a5-ad155cbcca86 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:16.039320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-13cf108b-7add-44cb-94a5-ad155cbcca86 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:16.048123 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-13cf108b-7add-44cb-94a5-ad155cbcca86 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:16.049625 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-13cf108b-7add-44cb-94a5-ad155cbcca86 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:16.050819 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-13cf108b-7add-44cb-94a5-ad155cbcca86 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1741 microversion: 2.20 time: 0.174792 Jul 11 14:23:16.051615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 450/889] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:15 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:17.068895 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-73a28c12-5f0d-4d80-a9a6-7dd253e8db09 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:17.069606 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-73a28c12-5f0d-4d80-a9a6-7dd253e8db09 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:17.076747 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-73a28c12-5f0d-4d80-a9a6-7dd253e8db09 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:17.077232 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-73a28c12-5f0d-4d80-a9a6-7dd253e8db09 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:17.078002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-73a28c12-5f0d-4d80-a9a6-7dd253e8db09 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:17.078471 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-73a28c12-5f0d-4d80-a9a6-7dd253e8db09 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:17.419576 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-73a28c12-5f0d-4d80-a9a6-7dd253e8db09 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:17.430740 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-73a28c12-5f0d-4d80-a9a6-7dd253e8db09 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:17.432748 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-73a28c12-5f0d-4d80-a9a6-7dd253e8db09 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:17.434230 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-73a28c12-5f0d-4d80-a9a6-7dd253e8db09 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1741 microversion: 2.20 time: 0.369251 Jul 11 14:23:17.435134 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 440/890] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:17 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1741 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:18.453453 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f2d3181d-257f-433b-a180-91a0189efe61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:18.454106 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f2d3181d-257f-433b-a180-91a0189efe61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:18.461731 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f2d3181d-257f-433b-a180-91a0189efe61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:18.462325 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f2d3181d-257f-433b-a180-91a0189efe61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:18.463196 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f2d3181d-257f-433b-a180-91a0189efe61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:18.463705 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f2d3181d-257f-433b-a180-91a0189efe61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:18.667680 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f2d3181d-257f-433b-a180-91a0189efe61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:18.677337 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f2d3181d-257f-433b-a180-91a0189efe61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:18.678807 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f2d3181d-257f-433b-a180-91a0189efe61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:18.680113 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f2d3181d-257f-433b-a180-91a0189efe61 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1741 microversion: 2.20 time: 0.230634 Jul 11 14:23:18.680706 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 451/891] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:18 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:19.698833 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4c9f7138-facf-4db5-997f-92289badb6b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:19.699443 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4c9f7138-facf-4db5-997f-92289badb6b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:19.705881 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c9f7138-facf-4db5-997f-92289badb6b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:19.706368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c9f7138-facf-4db5-997f-92289badb6b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:19.707132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c9f7138-facf-4db5-997f-92289badb6b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:19.707608 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c9f7138-facf-4db5-997f-92289badb6b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:19.841068 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4c9f7138-facf-4db5-997f-92289badb6b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:19.853041 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4c9f7138-facf-4db5-997f-92289badb6b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:19.854578 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4c9f7138-facf-4db5-997f-92289badb6b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:19.855740 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4c9f7138-facf-4db5-997f-92289badb6b5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1741 microversion: 2.20 time: 0.160808 Jul 11 14:23:19.856302 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 441/892] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:19 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:20.875622 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-16ba5897-b995-4619-9ef5-48b1c44e7d3f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:20.876172 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-16ba5897-b995-4619-9ef5-48b1c44e7d3f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:20.882817 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16ba5897-b995-4619-9ef5-48b1c44e7d3f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:20.883281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16ba5897-b995-4619-9ef5-48b1c44e7d3f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:20.884074 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16ba5897-b995-4619-9ef5-48b1c44e7d3f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:20.884512 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16ba5897-b995-4619-9ef5-48b1c44e7d3f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:21.104303 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-16ba5897-b995-4619-9ef5-48b1c44e7d3f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:21.112227 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-16ba5897-b995-4619-9ef5-48b1c44e7d3f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:21.113740 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-16ba5897-b995-4619-9ef5-48b1c44e7d3f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:21.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-16ba5897-b995-4619-9ef5-48b1c44e7d3f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1723 microversion: 2.20 time: 0.244152 Jul 11 14:23:21.116025 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 452/893] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:20 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:22.134995 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-16c8c23f-d6d2-4f17-b786-6eb9bc8eeaf7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:22.135574 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-16c8c23f-d6d2-4f17-b786-6eb9bc8eeaf7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:22.137938 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=29 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:22.143714 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16c8c23f-d6d2-4f17-b786-6eb9bc8eeaf7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:22.144161 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16c8c23f-d6d2-4f17-b786-6eb9bc8eeaf7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:22.144936 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16c8c23f-d6d2-4f17-b786-6eb9bc8eeaf7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:22.146004 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16c8c23f-d6d2-4f17-b786-6eb9bc8eeaf7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:22.148829 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=79 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:22.262122 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4171a704-0aaa-4e60-bcfc-dbe1904ef186 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:22.262812 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4171a704-0aaa-4e60-bcfc-dbe1904ef186 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:22.265298 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=29 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:22.271455 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4171a704-0aaa-4e60-bcfc-dbe1904ef186 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:22.271923 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4171a704-0aaa-4e60-bcfc-dbe1904ef186 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:22.272704 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4171a704-0aaa-4e60-bcfc-dbe1904ef186 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:22.273170 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4171a704-0aaa-4e60-bcfc-dbe1904ef186 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:22.275876 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:22.290124 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-16c8c23f-d6d2-4f17-b786-6eb9bc8eeaf7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:22.298566 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-16c8c23f-d6d2-4f17-b786-6eb9bc8eeaf7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:22.299506 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4171a704-0aaa-4e60-bcfc-dbe1904ef186 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44/ips" status: 200 len: 150 microversion: 2.1 time: 0.041251 Jul 11 14:23:22.300074 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-16c8c23f-d6d2-4f17-b786-6eb9bc8eeaf7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:22.300242 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 453/894] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 11 14:23:22 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:23:22.301311 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-16c8c23f-d6d2-4f17-b786-6eb9bc8eeaf7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1723 microversion: 2.20 time: 0.170323 Jul 11 14:23:22.302244 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 442/895] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:22 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:23.321164 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b2c216df-faaa-40d5-84cf-a591756da73d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:23.321731 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b2c216df-faaa-40d5-84cf-a591756da73d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:23.328215 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2c216df-faaa-40d5-84cf-a591756da73d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:23.328672 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2c216df-faaa-40d5-84cf-a591756da73d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:23.329444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2c216df-faaa-40d5-84cf-a591756da73d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:23.329886 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2c216df-faaa-40d5-84cf-a591756da73d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:23.465913 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b2c216df-faaa-40d5-84cf-a591756da73d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:23.476019 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b2c216df-faaa-40d5-84cf-a591756da73d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:23.477587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b2c216df-faaa-40d5-84cf-a591756da73d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:23.478820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b2c216df-faaa-40d5-84cf-a591756da73d tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1726 microversion: 2.20 time: 0.161924 Jul 11 14:23:23.479389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 454/896] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:23 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:23.505676 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-922ac35e-7ef9-4ef2-b7c7-7922c6eac146 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e564515-3d24-4afc-9d0f-c376ef657a81"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:23:23.506861 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-922ac35e-7ef9-4ef2-b7c7-7922c6eac146 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:23.514585 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-922ac35e-7ef9-4ef2-b7c7-7922c6eac146 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:23.515038 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-922ac35e-7ef9-4ef2-b7c7-7922c6eac146 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:23.515823 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-922ac35e-7ef9-4ef2-b7c7-7922c6eac146 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:23.516266 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-922ac35e-7ef9-4ef2-b7c7-7922c6eac146 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:23.634291 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-db67ea8c-9404-4942-89b3-24ef72855f46 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eac7967b-f8fd-4465-a4c2-633bd1739c91"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:23:23.635588 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-db67ea8c-9404-4942-89b3-24ef72855f46 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:23.641967 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db67ea8c-9404-4942-89b3-24ef72855f46 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:23.642455 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db67ea8c-9404-4942-89b3-24ef72855f46 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:23.643240 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db67ea8c-9404-4942-89b3-24ef72855f46 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:23.643682 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db67ea8c-9404-4942-89b3-24ef72855f46 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:23.807483 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-922ac35e-7ef9-4ef2-b7c7-7922c6eac146 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "POST /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306571 Jul 11 14:23:23.808175 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 443/897] 10.222.0.66 () {62 vars in 1363 bytes} [Mon Jul 11 14:23:23 2022] POST /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:23:23.920759 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-db67ea8c-9404-4942-89b3-24ef72855f46 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "POST /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291881 Jul 11 14:23:23.921547 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 455/898] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 11 14:23:23 2022] POST /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:23:23.940562 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-125822f3-2996-4edf-b9a7-903ef8e5ccf5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:23.940820 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-125822f3-2996-4edf-b9a7-903ef8e5ccf5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:23.955578 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-125822f3-2996-4edf-b9a7-903ef8e5ccf5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:23.955578 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-125822f3-2996-4edf-b9a7-903ef8e5ccf5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:23.955578 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-125822f3-2996-4edf-b9a7-903ef8e5ccf5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:23.955578 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-125822f3-2996-4edf-b9a7-903ef8e5ccf5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:24.219410 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-125822f3-2996-4edf-b9a7-903ef8e5ccf5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa/os-volume_attachments/5e564515-3d24-4afc-9d0f-c376ef657a81" status: 202 len: 0 microversion: 2.20 time: 0.287135 Jul 11 14:23:24.220009 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 444/899] 10.222.0.66 () {60 vars in 1456 bytes} [Mon Jul 11 14:23:23 2022] DELETE /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa/os-volume_attachments/5e564515-3d24-4afc-9d0f-c376ef657a81 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:23:24.276161 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-208aca27-7bf2-469c-874d-28942aaa8f22 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:23:24.276829 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-208aca27-7bf2-469c-874d-28942aaa8f22 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:24.283128 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-208aca27-7bf2-469c-874d-28942aaa8f22 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:24.283583 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-208aca27-7bf2-469c-874d-28942aaa8f22 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:24.284352 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-208aca27-7bf2-469c-874d-28942aaa8f22 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:24.284792 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-208aca27-7bf2-469c-874d-28942aaa8f22 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:24.364327 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-208aca27-7bf2-469c-874d-28942aaa8f22 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "POST /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa/action" status: 202 len: 0 microversion: 2.20 time: 0.092076 Jul 11 14:23:24.364994 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 456/900] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Jul 11 14:23:24 2022] POST /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:23:24.373256 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a317ba7c-f13d-46b3-8b8c-b4165d09065f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:24.373863 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a317ba7c-f13d-46b3-8b8c-b4165d09065f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:24.381322 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a317ba7c-f13d-46b3-8b8c-b4165d09065f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:24.381780 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a317ba7c-f13d-46b3-8b8c-b4165d09065f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:24.382600 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a317ba7c-f13d-46b3-8b8c-b4165d09065f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:24.383051 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a317ba7c-f13d-46b3-8b8c-b4165d09065f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:24.495392 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-ebbf01a5-6e08-42ce-b02e-eab1a2621bdf req-389094d0-d99c-44f7-a2d2-580fdc9deb57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a20f292-9867-4b58-a3eb-12f153edd3aa", "name": "network-vif-unplugged", "status": "completed", "tag": "802d4a9e-0fa0-41e8-876a-385488fc4283"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:23:24.507393 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ebbf01a5-6e08-42ce-b02e-eab1a2621bdf req-389094d0-d99c-44f7-a2d2-580fdc9deb57 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:24.507943 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ebbf01a5-6e08-42ce-b02e-eab1a2621bdf req-389094d0-d99c-44f7-a2d2-580fdc9deb57 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:24.523853 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.compute.server_external_events [req-ebbf01a5-6e08-42ce-b02e-eab1a2621bdf req-389094d0-d99c-44f7-a2d2-580fdc9deb57 service nova] Unable to find a host for instance 5a20f292-9867-4b58-a3eb-12f153edd3aa. Dropping event network-vif-unplugged {{(pid=117920) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 11 14:23:24.525598 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-ebbf01a5-6e08-42ce-b02e-eab1a2621bdf req-389094d0-d99c-44f7-a2d2-580fdc9deb57 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042556 Jul 11 14:23:24.526693 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 457/901] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 11 14:23:24.534966 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a317ba7c-f13d-46b3-8b8c-b4165d09065f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:24.547414 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a317ba7c-f13d-46b3-8b8c-b4165d09065f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:24.549269 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a317ba7c-f13d-46b3-8b8c-b4165d09065f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:24.550472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a317ba7c-f13d-46b3-8b8c-b4165d09065f tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1674 microversion: 2.20 time: 0.181169 Jul 11 14:23:24.551031 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 445/902] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:24 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:25.570393 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-50873c30-f04c-4515-a589-0935b6259ae9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:25.571117 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-50873c30-f04c-4515-a589-0935b6259ae9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:25.578593 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50873c30-f04c-4515-a589-0935b6259ae9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:25.579200 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50873c30-f04c-4515-a589-0935b6259ae9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:25.580069 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50873c30-f04c-4515-a589-0935b6259ae9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:25.580588 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50873c30-f04c-4515-a589-0935b6259ae9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:25.719403 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-50873c30-f04c-4515-a589-0935b6259ae9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:25.727570 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-50873c30-f04c-4515-a589-0935b6259ae9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:25.729075 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-50873c30-f04c-4515-a589-0935b6259ae9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:25.730255 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-50873c30-f04c-4515-a589-0935b6259ae9 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.165102 Jul 11 14:23:25.730833 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 458/903] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:25 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:26.750852 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-80a08295-6d69-4955-83fc-538ef36d8a59 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:26.751594 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-80a08295-6d69-4955-83fc-538ef36d8a59 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:26.760011 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-80a08295-6d69-4955-83fc-538ef36d8a59 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:26.760467 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-80a08295-6d69-4955-83fc-538ef36d8a59 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:26.761246 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-80a08295-6d69-4955-83fc-538ef36d8a59 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:26.761683 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-80a08295-6d69-4955-83fc-538ef36d8a59 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:26.968891 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-80a08295-6d69-4955-83fc-538ef36d8a59 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:26.983503 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-80a08295-6d69-4955-83fc-538ef36d8a59 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:26.985719 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-80a08295-6d69-4955-83fc-538ef36d8a59 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:26.987344 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-80a08295-6d69-4955-83fc-538ef36d8a59 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.240196 Jul 11 14:23:26.999678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 446/904] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:26 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:27.077928 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ab83742b-ef48-4feb-81a0-6901ca354582 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:27.078478 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ab83742b-ef48-4feb-81a0-6901ca354582 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:27.080591 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-c6e51eca-0301-4cfe-a694-e8f31104e993 req-55a2f043-64eb-4712-b467-87b887fa1076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c823a7a9-0fb0-42b9-af86-8cf9697b9036", "tag": "6a382ee4-94ce-4073-9f34-0eea75f61a5c"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:23:27.086203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab83742b-ef48-4feb-81a0-6901ca354582 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:27.086671 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab83742b-ef48-4feb-81a0-6901ca354582 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:27.087459 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab83742b-ef48-4feb-81a0-6901ca354582 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:27.088077 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab83742b-ef48-4feb-81a0-6901ca354582 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:27.089641 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-c6e51eca-0301-4cfe-a694-e8f31104e993 req-55a2f043-64eb-4712-b467-87b887fa1076 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:27.090103 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-c6e51eca-0301-4cfe-a694-e8f31104e993 req-55a2f043-64eb-4712-b467-87b887fa1076 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:27.102827 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-c6e51eca-0301-4cfe-a694-e8f31104e993 req-55a2f043-64eb-4712-b467-87b887fa1076 service nova] Creating event network-changed:6a382ee4-94ce-4073-9f34-0eea75f61a5c for instance c823a7a9-0fb0-42b9-af86-8cf9697b9036 on hv-cinder-81914 Jul 11 14:23:27.108755 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-c6e51eca-0301-4cfe-a694-e8f31104e993 req-55a2f043-64eb-4712-b467-87b887fa1076 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031909 Jul 11 14:23:27.110222 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 447/905] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:23:27.117614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ab83742b-ef48-4feb-81a0-6901ca354582 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:23:27.202282 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ab83742b-ef48-4feb-81a0-6901ca354582 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 204 len: 0 microversion: 2.1 time: 0.127992 Jul 11 14:23:27.205901 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 459/906] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:23:27 2022] DELETE /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:23:27.213327 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4728427b-1a19-4fb1-b33c-cf9861e9580e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:27.214313 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4728427b-1a19-4fb1-b33c-cf9861e9580e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:27.220697 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4728427b-1a19-4fb1-b33c-cf9861e9580e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:27.221145 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4728427b-1a19-4fb1-b33c-cf9861e9580e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:27.221909 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4728427b-1a19-4fb1-b33c-cf9861e9580e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:27.222490 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4728427b-1a19-4fb1-b33c-cf9861e9580e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:27.363564 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4728427b-1a19-4fb1-b33c-cf9861e9580e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:27.372314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4728427b-1a19-4fb1-b33c-cf9861e9580e tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1577 microversion: 2.1 time: 0.164652 Jul 11 14:23:27.372922 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 448/907] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:27 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:28.007500 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e750baad-1105-4d89-bc9b-2817370766ba tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:28.008248 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e750baad-1105-4d89-bc9b-2817370766ba tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:28.014531 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e750baad-1105-4d89-bc9b-2817370766ba tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:28.014972 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e750baad-1105-4d89-bc9b-2817370766ba tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:28.015749 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e750baad-1105-4d89-bc9b-2817370766ba tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:28.016182 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e750baad-1105-4d89-bc9b-2817370766ba tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:28.153236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e750baad-1105-4d89-bc9b-2817370766ba tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:28.161808 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e750baad-1105-4d89-bc9b-2817370766ba tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:28.163364 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e750baad-1105-4d89-bc9b-2817370766ba tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:28.164538 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e750baad-1105-4d89-bc9b-2817370766ba tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.161978 Jul 11 14:23:28.165108 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 460/908] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:28 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:28.391850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-128c9406-b1b3-48f2-9330-1b80f6181359 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:28.392605 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-128c9406-b1b3-48f2-9330-1b80f6181359 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:28.399743 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-128c9406-b1b3-48f2-9330-1b80f6181359 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:28.400128 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-128c9406-b1b3-48f2-9330-1b80f6181359 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:28.400900 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-128c9406-b1b3-48f2-9330-1b80f6181359 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:28.401342 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-128c9406-b1b3-48f2-9330-1b80f6181359 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:28.534143 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-128c9406-b1b3-48f2-9330-1b80f6181359 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:28.542465 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-128c9406-b1b3-48f2-9330-1b80f6181359 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1577 microversion: 2.1 time: 0.154507 Jul 11 14:23:28.543042 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 449/909] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:28 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:29.182653 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-60ebc7aa-19d2-421f-aa17-5b0b26fe3138 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:29.183269 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-60ebc7aa-19d2-421f-aa17-5b0b26fe3138 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:29.189910 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60ebc7aa-19d2-421f-aa17-5b0b26fe3138 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:29.190401 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60ebc7aa-19d2-421f-aa17-5b0b26fe3138 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:29.191165 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60ebc7aa-19d2-421f-aa17-5b0b26fe3138 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:29.191750 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60ebc7aa-19d2-421f-aa17-5b0b26fe3138 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:29.357245 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-60ebc7aa-19d2-421f-aa17-5b0b26fe3138 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:29.365732 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-60ebc7aa-19d2-421f-aa17-5b0b26fe3138 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:29.367682 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-60ebc7aa-19d2-421f-aa17-5b0b26fe3138 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:29.369128 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-60ebc7aa-19d2-421f-aa17-5b0b26fe3138 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.190479 Jul 11 14:23:29.369892 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 461/910] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:29 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:29.560510 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b64f9158-1ff8-4461-b6e2-ed71e3e1b9fe tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:29.561919 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b64f9158-1ff8-4461-b6e2-ed71e3e1b9fe tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:29.573132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b64f9158-1ff8-4461-b6e2-ed71e3e1b9fe tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:29.581104 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b64f9158-1ff8-4461-b6e2-ed71e3e1b9fe tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:29.583097 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b64f9158-1ff8-4461-b6e2-ed71e3e1b9fe tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:29.583794 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b64f9158-1ff8-4461-b6e2-ed71e3e1b9fe tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:29.850890 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b64f9158-1ff8-4461-b6e2-ed71e3e1b9fe tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:29.860780 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b64f9158-1ff8-4461-b6e2-ed71e3e1b9fe tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1577 microversion: 2.1 time: 0.304120 Jul 11 14:23:29.862072 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 450/911] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:29 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1577 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:23:30.102484 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-38d333e4-a01f-45cd-8cc4-0d39ca0a7527 req-a7d35184-a2ce-4e7b-ba6a-0c97df2e8937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c823a7a9-0fb0-42b9-af86-8cf9697b9036", "name": "network-vif-deleted", "tag": "6a382ee4-94ce-4073-9f34-0eea75f61a5c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:23:30.111372 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-38d333e4-a01f-45cd-8cc4-0d39ca0a7527 req-a7d35184-a2ce-4e7b-ba6a-0c97df2e8937 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:30.111808 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-38d333e4-a01f-45cd-8cc4-0d39ca0a7527 req-a7d35184-a2ce-4e7b-ba6a-0c97df2e8937 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:30.134267 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-38d333e4-a01f-45cd-8cc4-0d39ca0a7527 req-a7d35184-a2ce-4e7b-ba6a-0c97df2e8937 service nova] Creating event network-vif-deleted:6a382ee4-94ce-4073-9f34-0eea75f61a5c for instance c823a7a9-0fb0-42b9-af86-8cf9697b9036 on hv-cinder-81914 Jul 11 14:23:30.143215 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-38d333e4-a01f-45cd-8cc4-0d39ca0a7527 req-a7d35184-a2ce-4e7b-ba6a-0c97df2e8937 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045025 Jul 11 14:23:30.144443 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 462/912] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:23:30.387458 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bab7c145-18b1-4eed-98f3-e0cacdeb9274 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:30.388262 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bab7c145-18b1-4eed-98f3-e0cacdeb9274 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:30.402330 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bab7c145-18b1-4eed-98f3-e0cacdeb9274 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:30.402813 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bab7c145-18b1-4eed-98f3-e0cacdeb9274 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:30.403592 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bab7c145-18b1-4eed-98f3-e0cacdeb9274 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:30.404021 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bab7c145-18b1-4eed-98f3-e0cacdeb9274 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:30.579455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bab7c145-18b1-4eed-98f3-e0cacdeb9274 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:30.591294 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bab7c145-18b1-4eed-98f3-e0cacdeb9274 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:30.592822 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bab7c145-18b1-4eed-98f3-e0cacdeb9274 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:30.594121 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bab7c145-18b1-4eed-98f3-e0cacdeb9274 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.210527 Jul 11 14:23:30.594797 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 451/913] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:30 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:30.881062 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c4ac0a24-d9ea-457f-912b-2221d466b7f8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:30.881884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c4ac0a24-d9ea-457f-912b-2221d466b7f8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:30.888946 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4ac0a24-d9ea-457f-912b-2221d466b7f8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:30.889391 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4ac0a24-d9ea-457f-912b-2221d466b7f8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:30.890186 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4ac0a24-d9ea-457f-912b-2221d466b7f8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:30.890637 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4ac0a24-d9ea-457f-912b-2221d466b7f8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:30.966794 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c4ac0a24-d9ea-457f-912b-2221d466b7f8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:30.976053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c4ac0a24-d9ea-457f-912b-2221d466b7f8 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1510 microversion: 2.1 time: 0.099634 Jul 11 14:23:30.981549 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 463/914] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:30 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1510 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:31.614105 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-93c48212-ec3e-4dd0-9ed7-391fd76e46cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:31.615079 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-93c48212-ec3e-4dd0-9ed7-391fd76e46cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:31.622342 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-93c48212-ec3e-4dd0-9ed7-391fd76e46cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:31.622885 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-93c48212-ec3e-4dd0-9ed7-391fd76e46cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:31.623796 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-93c48212-ec3e-4dd0-9ed7-391fd76e46cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:31.624242 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-93c48212-ec3e-4dd0-9ed7-391fd76e46cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:31.778262 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-93c48212-ec3e-4dd0-9ed7-391fd76e46cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:31.788511 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-93c48212-ec3e-4dd0-9ed7-391fd76e46cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:31.790450 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-93c48212-ec3e-4dd0-9ed7-391fd76e46cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:31.791960 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-93c48212-ec3e-4dd0-9ed7-391fd76e46cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.183071 Jul 11 14:23:31.792888 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 452/915] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:31 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:23:31.994963 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1eb64d30-90cc-4674-b625-bd8fbc75c6f4 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:31.995590 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1eb64d30-90cc-4674-b625-bd8fbc75c6f4 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:32.002437 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1eb64d30-90cc-4674-b625-bd8fbc75c6f4 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:32.002924 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1eb64d30-90cc-4674-b625-bd8fbc75c6f4 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:32.003767 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1eb64d30-90cc-4674-b625-bd8fbc75c6f4 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:32.004635 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1eb64d30-90cc-4674-b625-bd8fbc75c6f4 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:32.074461 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1eb64d30-90cc-4674-b625-bd8fbc75c6f4 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:32.083086 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1eb64d30-90cc-4674-b625-bd8fbc75c6f4 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1510 microversion: 2.1 time: 0.091940 Jul 11 14:23:32.083669 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 464/916] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:31 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1510 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:23:32.810810 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-993288f4-4399-45d9-aadf-da57a21ac0bb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:32.812236 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-993288f4-4399-45d9-aadf-da57a21ac0bb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:32.819853 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-993288f4-4399-45d9-aadf-da57a21ac0bb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:32.820583 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-993288f4-4399-45d9-aadf-da57a21ac0bb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:32.821836 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-993288f4-4399-45d9-aadf-da57a21ac0bb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:32.822528 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-993288f4-4399-45d9-aadf-da57a21ac0bb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:32.982536 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-993288f4-4399-45d9-aadf-da57a21ac0bb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:32.992293 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-993288f4-4399-45d9-aadf-da57a21ac0bb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:32.994073 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-993288f4-4399-45d9-aadf-da57a21ac0bb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:32.995379 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-993288f4-4399-45d9-aadf-da57a21ac0bb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.188452 Jul 11 14:23:32.996295 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 453/917] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:32 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:33.100572 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-11397d04-df72-4ee2-9496-51b0a3cfde02 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:33.101160 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-11397d04-df72-4ee2-9496-51b0a3cfde02 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:33.107730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11397d04-df72-4ee2-9496-51b0a3cfde02 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:33.108179 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11397d04-df72-4ee2-9496-51b0a3cfde02 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:33.108955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11397d04-df72-4ee2-9496-51b0a3cfde02 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:33.109379 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11397d04-df72-4ee2-9496-51b0a3cfde02 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:33.176657 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-11397d04-df72-4ee2-9496-51b0a3cfde02 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:33.185095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-11397d04-df72-4ee2-9496-51b0a3cfde02 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1510 microversion: 2.1 time: 0.088634 Jul 11 14:23:33.185903 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 465/918] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:33 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1510 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:34.013567 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-62565818-6c55-451a-9ffd-ae645eb17946 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:34.014199 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-62565818-6c55-451a-9ffd-ae645eb17946 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:34.021463 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-62565818-6c55-451a-9ffd-ae645eb17946 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:34.021933 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-62565818-6c55-451a-9ffd-ae645eb17946 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:34.022760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-62565818-6c55-451a-9ffd-ae645eb17946 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:34.023199 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-62565818-6c55-451a-9ffd-ae645eb17946 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:34.027759 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:34.177615 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-62565818-6c55-451a-9ffd-ae645eb17946 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:34.187330 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-62565818-6c55-451a-9ffd-ae645eb17946 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:34.189375 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-62565818-6c55-451a-9ffd-ae645eb17946 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:34.194437 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-62565818-6c55-451a-9ffd-ae645eb17946 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.184563 Jul 11 14:23:34.195385 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 454/919] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:34 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:34.208325 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5716a63f-cc8d-4a37-b8d8-fb5af29d7101 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:34.217703 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5716a63f-cc8d-4a37-b8d8-fb5af29d7101 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:34.225644 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5716a63f-cc8d-4a37-b8d8-fb5af29d7101 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:34.226478 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5716a63f-cc8d-4a37-b8d8-fb5af29d7101 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:34.227490 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5716a63f-cc8d-4a37-b8d8-fb5af29d7101 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:34.228128 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5716a63f-cc8d-4a37-b8d8-fb5af29d7101 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:34.297043 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5716a63f-cc8d-4a37-b8d8-fb5af29d7101 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:34.306809 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5716a63f-cc8d-4a37-b8d8-fb5af29d7101 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1510 microversion: 2.1 time: 0.103128 Jul 11 14:23:34.307398 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 466/920] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:34 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1510 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:35.220058 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3d3e6d04-6d2c-4c0d-9e0b-2c0b39aed2e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:35.221359 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3d3e6d04-6d2c-4c0d-9e0b-2c0b39aed2e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:35.228864 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d3e6d04-6d2c-4c0d-9e0b-2c0b39aed2e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:35.229400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d3e6d04-6d2c-4c0d-9e0b-2c0b39aed2e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:35.230168 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d3e6d04-6d2c-4c0d-9e0b-2c0b39aed2e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:35.230610 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d3e6d04-6d2c-4c0d-9e0b-2c0b39aed2e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:35.325845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3108d6a1-45ee-4d4a-bcf7-9f8877cc031d tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:35.326487 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3108d6a1-45ee-4d4a-bcf7-9f8877cc031d tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:35.334470 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3108d6a1-45ee-4d4a-bcf7-9f8877cc031d tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:35.334907 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3108d6a1-45ee-4d4a-bcf7-9f8877cc031d tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:35.335685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3108d6a1-45ee-4d4a-bcf7-9f8877cc031d tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:35.336112 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3108d6a1-45ee-4d4a-bcf7-9f8877cc031d tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:35.358391 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:35.384676 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3d3e6d04-6d2c-4c0d-9e0b-2c0b39aed2e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:35.393231 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3d3e6d04-6d2c-4c0d-9e0b-2c0b39aed2e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:35.395277 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3d3e6d04-6d2c-4c0d-9e0b-2c0b39aed2e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:35.397251 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3d3e6d04-6d2c-4c0d-9e0b-2c0b39aed2e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.187902 Jul 11 14:23:35.398027 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 455/921] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:35 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:23:35.411116 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3108d6a1-45ee-4d4a-bcf7-9f8877cc031d tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:35.420287 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3108d6a1-45ee-4d4a-bcf7-9f8877cc031d tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1510 microversion: 2.1 time: 0.098025 Jul 11 14:23:35.421076 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 467/922] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:35 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1510 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:23:36.417092 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ba37139d-9491-4fdc-b12e-f8e8cb7e995a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:36.417722 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ba37139d-9491-4fdc-b12e-f8e8cb7e995a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:36.425032 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ba37139d-9491-4fdc-b12e-f8e8cb7e995a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:36.425495 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ba37139d-9491-4fdc-b12e-f8e8cb7e995a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:36.426314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ba37139d-9491-4fdc-b12e-f8e8cb7e995a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:36.426824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ba37139d-9491-4fdc-b12e-f8e8cb7e995a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:36.436952 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bb72f538-b109-4bd9-b649-02dd266b8989 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:36.437572 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bb72f538-b109-4bd9-b649-02dd266b8989 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:36.447249 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb72f538-b109-4bd9-b649-02dd266b8989 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:36.448849 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb72f538-b109-4bd9-b649-02dd266b8989 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:36.449909 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb72f538-b109-4bd9-b649-02dd266b8989 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:36.450530 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb72f538-b109-4bd9-b649-02dd266b8989 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:36.527901 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bb72f538-b109-4bd9-b649-02dd266b8989 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:36.535976 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bb72f538-b109-4bd9-b649-02dd266b8989 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1510 microversion: 2.1 time: 0.102864 Jul 11 14:23:36.537525 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 468/923] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:36 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1510 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:23:36.571097 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ba37139d-9491-4fdc-b12e-f8e8cb7e995a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:36.580083 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ba37139d-9491-4fdc-b12e-f8e8cb7e995a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:36.581007 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ba37139d-9491-4fdc-b12e-f8e8cb7e995a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:36.582237 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ba37139d-9491-4fdc-b12e-f8e8cb7e995a tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.169249 Jul 11 14:23:36.582802 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 456/924] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:36 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:37.553826 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f9b374be-3a18-464a-b071-91c78784dd84 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:37.554445 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f9b374be-3a18-464a-b071-91c78784dd84 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:37.561103 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9b374be-3a18-464a-b071-91c78784dd84 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:37.561647 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9b374be-3a18-464a-b071-91c78784dd84 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:37.562438 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9b374be-3a18-464a-b071-91c78784dd84 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:37.563236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9b374be-3a18-464a-b071-91c78784dd84 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:37.601246 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-51c988c0-702f-47d7-97db-c4d526bb46c0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:37.601888 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-51c988c0-702f-47d7-97db-c4d526bb46c0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:37.608472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51c988c0-702f-47d7-97db-c4d526bb46c0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:37.608938 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51c988c0-702f-47d7-97db-c4d526bb46c0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:37.609709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51c988c0-702f-47d7-97db-c4d526bb46c0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:37.610140 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51c988c0-702f-47d7-97db-c4d526bb46c0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:37.625190 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f9b374be-3a18-464a-b071-91c78784dd84 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:37.633335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f9b374be-3a18-464a-b071-91c78784dd84 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1510 microversion: 2.1 time: 0.083663 Jul 11 14:23:37.634023 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 469/925] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:37 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1510 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:37.750644 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-51c988c0-702f-47d7-97db-c4d526bb46c0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:37.759829 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-51c988c0-702f-47d7-97db-c4d526bb46c0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:37.761350 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-51c988c0-702f-47d7-97db-c4d526bb46c0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:37.762574 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-51c988c0-702f-47d7-97db-c4d526bb46c0 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.165928 Jul 11 14:23:37.763143 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 457/926] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:37 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:23:38.650614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f951f782-6b39-40dc-b2b0-ce3928372edc tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:38.651240 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f951f782-6b39-40dc-b2b0-ce3928372edc tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:38.657877 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f951f782-6b39-40dc-b2b0-ce3928372edc tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:38.658375 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f951f782-6b39-40dc-b2b0-ce3928372edc tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:38.659156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f951f782-6b39-40dc-b2b0-ce3928372edc tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:38.659595 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f951f782-6b39-40dc-b2b0-ce3928372edc tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:38.724414 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f951f782-6b39-40dc-b2b0-ce3928372edc tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:38.730988 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f951f782-6b39-40dc-b2b0-ce3928372edc tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1510 microversion: 2.1 time: 0.084461 Jul 11 14:23:38.731568 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 470/927] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:38 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1510 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:38.780771 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-38cb22c7-2fc5-4d95-8099-ec586914d2a2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:38.781469 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-38cb22c7-2fc5-4d95-8099-ec586914d2a2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:38.788931 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38cb22c7-2fc5-4d95-8099-ec586914d2a2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:38.789384 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38cb22c7-2fc5-4d95-8099-ec586914d2a2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:38.790179 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38cb22c7-2fc5-4d95-8099-ec586914d2a2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:38.790633 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38cb22c7-2fc5-4d95-8099-ec586914d2a2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:38.921077 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-38cb22c7-2fc5-4d95-8099-ec586914d2a2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:38.928962 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-38cb22c7-2fc5-4d95-8099-ec586914d2a2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:38.930636 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-38cb22c7-2fc5-4d95-8099-ec586914d2a2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:38.931882 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-38cb22c7-2fc5-4d95-8099-ec586914d2a2 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.155078 Jul 11 14:23:38.932349 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 458/928] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:38 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:39.748167 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3018fb03-5d41-4ccb-a321-14d1453ffc06 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:39.748728 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3018fb03-5d41-4ccb-a321-14d1453ffc06 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:39.755121 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3018fb03-5d41-4ccb-a321-14d1453ffc06 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:39.755577 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3018fb03-5d41-4ccb-a321-14d1453ffc06 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:39.756365 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3018fb03-5d41-4ccb-a321-14d1453ffc06 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:39.756809 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3018fb03-5d41-4ccb-a321-14d1453ffc06 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:39.825389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3018fb03-5d41-4ccb-a321-14d1453ffc06 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:39.835037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3018fb03-5d41-4ccb-a321-14d1453ffc06 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1226 microversion: 2.1 time: 0.090693 Jul 11 14:23:39.835870 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 471/929] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:39 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:39.949985 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8b5d4b20-5756-4af6-9b07-629b2ef9f7fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:39.950606 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8b5d4b20-5756-4af6-9b07-629b2ef9f7fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:39.957231 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b5d4b20-5756-4af6-9b07-629b2ef9f7fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:39.957679 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b5d4b20-5756-4af6-9b07-629b2ef9f7fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:39.959065 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b5d4b20-5756-4af6-9b07-629b2ef9f7fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:39.959559 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b5d4b20-5756-4af6-9b07-629b2ef9f7fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:40.092639 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8b5d4b20-5756-4af6-9b07-629b2ef9f7fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:40.101134 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8b5d4b20-5756-4af6-9b07-629b2ef9f7fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:40.103353 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8b5d4b20-5756-4af6-9b07-629b2ef9f7fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:40.104519 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8b5d4b20-5756-4af6-9b07-629b2ef9f7fe tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.158682 Jul 11 14:23:40.105086 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 459/930] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:39 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:40.852538 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-29cd842e-2c6e-4d4f-9d58-5d86a41172da tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:40.853159 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-29cd842e-2c6e-4d4f-9d58-5d86a41172da tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:40.859699 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29cd842e-2c6e-4d4f-9d58-5d86a41172da tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:40.860153 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29cd842e-2c6e-4d4f-9d58-5d86a41172da tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:40.860919 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29cd842e-2c6e-4d4f-9d58-5d86a41172da tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:40.861355 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29cd842e-2c6e-4d4f-9d58-5d86a41172da tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:40.892653 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29cd842e-2c6e-4d4f-9d58-5d86a41172da tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:40.893107 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29cd842e-2c6e-4d4f-9d58-5d86a41172da tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:40.893558 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-29cd842e-2c6e-4d4f-9d58-5d86a41172da tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lazy-loading 'fault' on Instance uuid c823a7a9-0fb0-42b9-af86-8cf9697b9036 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:23:40.935503 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-29cd842e-2c6e-4d4f-9d58-5d86a41172da tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:40.943288 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-29cd842e-2c6e-4d4f-9d58-5d86a41172da tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 200 len: 1231 microversion: 2.1 time: 0.095200 Jul 11 14:23:40.943864 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 472/931] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:40 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:41.122799 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-eb08d3c2-e2d9-4922-b070-a0a4cbba871c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:41.123395 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-eb08d3c2-e2d9-4922-b070-a0a4cbba871c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:41.129848 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb08d3c2-e2d9-4922-b070-a0a4cbba871c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:41.130500 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb08d3c2-e2d9-4922-b070-a0a4cbba871c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:41.131268 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb08d3c2-e2d9-4922-b070-a0a4cbba871c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:41.131701 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb08d3c2-e2d9-4922-b070-a0a4cbba871c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:41.263961 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-eb08d3c2-e2d9-4922-b070-a0a4cbba871c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:41.272786 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-eb08d3c2-e2d9-4922-b070-a0a4cbba871c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:41.274309 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-eb08d3c2-e2d9-4922-b070-a0a4cbba871c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:41.275461 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-eb08d3c2-e2d9-4922-b070-a0a4cbba871c tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.156703 Jul 11 14:23:41.276030 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 460/932] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:41 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:41.961679 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2cbd214c-c3bc-47ae-abf9-d0791934b044 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:41.962482 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2cbd214c-c3bc-47ae-abf9-d0791934b044 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: c823a7a9-0fb0-42b9-af86-8cf9697b9036] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:41.969712 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2cbd214c-c3bc-47ae-abf9-d0791934b044 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:41.971586 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2cbd214c-c3bc-47ae-abf9-d0791934b044 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:41.972395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2cbd214c-c3bc-47ae-abf9-d0791934b044 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:41.972834 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2cbd214c-c3bc-47ae-abf9-d0791934b044 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:41.992109 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-2cbd214c-c3bc-47ae-abf9-d0791934b044 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] HTTP exception thrown: Instance c823a7a9-0fb0-42b9-af86-8cf9697b9036 could not be found. Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2cbd214c-c3bc-47ae-abf9-d0791934b044 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Request method failure captured: Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 HTTP/1.1 Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDCWtrVPQbCUpon-pQ1xYhol8hBL6rk3TSkFxcaTbkECgG6FsCfZ2TYnTfbWTAw4B3A0QrIHkMoyrs8lZW3RyaBx-cBGYTGvlonbC5nfUHo8rg37cEdW1Xv9NfrPtPm332_ZshUaTRn39MebhPgRYP1k3wxtyWEO1b2zP9eJb5_Hd-0 Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 8da67a5ec9194e7bad1eb52c45a584bf Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestVolumeBootPattern-1971221977 Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:23:41.994183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:23:41.995955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:23:41.995955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestVolumeBootPattern-1971221977 Jul 11 14:23:41.995955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 8da67a5ec9194e7bad1eb52c45a584bf Jul 11 14:23:41.995955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestVolumeBootPattern-1971221977 Jul 11 14:23:41.995955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-TestVolumeBootPattern-1971221977-project Jul 11 14:23:41.995955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:23:41.995955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:23:41.995955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 5383a1d1bec34094a1889a86d87a88b5 Jul 11 14:23:41.995955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestVolumeBootPattern-1971221977-project Jul 11 14:23:41.995955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:23:41.995955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance c823a7a9-0fb0-42b9-af86-8cf9697b9036 could not be found. Jul 11 14:23:41.995955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': 'c823a7a9-0fb0-42b9-af86-8cf9697b9036'} Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c823a7a9-0fb0-42b9-af86-8cf9697b9036 could not be found. Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:23:41.999320 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:23:42.004236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:23:42.004236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:23:42.004236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:23:42.004236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:23:42.004236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:23:42.004236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:23:42.004236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:23:42.004236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c823a7a9-0fb0-42b9-af86-8cf9697b9036 could not be found. Jul 11 14:23:42.004236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:23:42.004236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:23:42.004236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:23:42.004236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:23:42.004236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:23:42.004236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:23:42.004236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:23:42.004236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:23:42.004236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c823a7a9-0fb0-42b9-af86-8cf9697b9036 could not be found. Jul 11 14:23:42.004236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:23:42.029307 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2cbd214c-c3bc-47ae-abf9-d0791934b044 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Returning 404 to user: Instance c823a7a9-0fb0-42b9-af86-8cf9697b9036 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:23:42.029307 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2cbd214c-c3bc-47ae-abf9-d0791934b044 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036" status: 404 len: 111 microversion: 2.1 time: 0.038815 Jul 11 14:23:42.029307 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 473/933] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:41 2022] GET /compute/v2.1/servers/c823a7a9-0fb0-42b9-af86-8cf9697b9036 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:23:42.069672 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-df89f7b0-2a3d-4369-bb4d-181e26d51695 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eac7967b-f8fd-4465-a4c2-633bd1739c91"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:23:42.070784 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-df89f7b0-2a3d-4369-bb4d-181e26d51695 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:42.076842 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df89f7b0-2a3d-4369-bb4d-181e26d51695 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:42.077332 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df89f7b0-2a3d-4369-bb4d-181e26d51695 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:42.078130 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df89f7b0-2a3d-4369-bb4d-181e26d51695 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:42.078617 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df89f7b0-2a3d-4369-bb4d-181e26d51695 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:42.165246 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-df89f7b0-2a3d-4369-bb4d-181e26d51695 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] HTTP exception thrown: Invalid volume: volume eac7967b-f8fd-4465-a4c2-633bd1739c91 is already attached to instances: f166a5e8-f81d-4879-aa18-19c8cf86cd44 Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-df89f7b0-2a3d-4369-bb4d-181e26d51695 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Request method failure captured: Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: POST /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44/os-volume_attachments HTTP/1.1 Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 74 Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDGazgesZ8gm-xkGX3sogYiEnmE9DbvhKeeh7tJMTX6Y58vVTm48pJ0qqerjCEqeh3Rk7vIu5Mf6TPbuSudm7DddzzEsc9NjqbILyr7XHvKKA7DT_oLLVUIhEbYpW0g3TYtb5AJyNnSid_YkDT-vH95HrvzbM46bM90tJC5hswTE0Jw Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:23:42.167078 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:23:42.168815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:23:42.168815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:23:42.168815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:23:42.168815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:23:42.168815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:23:42.168815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:23:42.168815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:23:42.168815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 5bbea49c1a55481c9995f04f2e9b8618 Jul 11 14:23:42.168815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:23:42.168815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Jul 11 14:23:42.168815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {"volumeAttachment": {"volumeId": "eac7967b-f8fd-4465-a4c2-633bd1739c91"}} Jul 11 14:23:42.168815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Invalid volume: volume eac7967b-f8fd-4465-a4c2-633bd1739c91 is already attached to instances: f166a5e8-f81d-4879-aa18-19c8cf86cd44 Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'server_id': 'f166a5e8-f81d-4879-aa18-19c8cf86cd44', 'body': {'volumeAttachment': {'volumeId': 'eac7967b-f8fd-4465-a4c2-633bd1739c91'}}} Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume eac7967b-f8fd-4465-a4c2-633bd1739c91 is already attached to instances: f166a5e8-f81d-4879-aa18-19c8cf86cd44 Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:23:42.173723 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume eac7967b-f8fd-4465-a4c2-633bd1739c91 is already attached to instances: f166a5e8-f81d-4879-aa18-19c8cf86cd44 Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:23:42.175221 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:23:42.176852 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:23:42.176852 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:23:42.176852 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:23:42.176852 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume eac7967b-f8fd-4465-a4c2-633bd1739c91 is already attached to instances: f166a5e8-f81d-4879-aa18-19c8cf86cd44 Jul 11 14:23:42.176852 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:23:42.176852 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-df89f7b0-2a3d-4369-bb4d-181e26d51695 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Returning 400 to user: Invalid volume: volume eac7967b-f8fd-4465-a4c2-633bd1739c91 is already attached to instances: f166a5e8-f81d-4879-aa18-19c8cf86cd44 {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:23:42.176852 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-df89f7b0-2a3d-4369-bb4d-181e26d51695 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "POST /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103490 Jul 11 14:23:42.176852 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 461/934] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 11 14:23:42 2022] POST /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 14:23:42.230142 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-52ac48b6-6752-4ce9-8bf9-d5107bcb2864 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:42.230685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-52ac48b6-6752-4ce9-8bf9-d5107bcb2864 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:42.236730 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52ac48b6-6752-4ce9-8bf9-d5107bcb2864 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:42.237182 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52ac48b6-6752-4ce9-8bf9-d5107bcb2864 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:42.237947 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52ac48b6-6752-4ce9-8bf9-d5107bcb2864 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:42.238418 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52ac48b6-6752-4ce9-8bf9-d5107bcb2864 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:42.293706 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e5e2e618-511c-42c4-8cf8-0402911465cf tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:42.294458 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e5e2e618-511c-42c4-8cf8-0402911465cf tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:42.301516 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5e2e618-511c-42c4-8cf8-0402911465cf tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:42.301974 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5e2e618-511c-42c4-8cf8-0402911465cf tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:42.302786 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5e2e618-511c-42c4-8cf8-0402911465cf tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:42.303225 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5e2e618-511c-42c4-8cf8-0402911465cf tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:42.324464 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-52ac48b6-6752-4ce9-8bf9-d5107bcb2864 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lazy-loading 'services' on Instance uuid f166a5e8-f81d-4879-aa18-19c8cf86cd44 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:23:42.400656 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-52ac48b6-6752-4ce9-8bf9-d5107bcb2864 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44/os-volume_attachments/eac7967b-f8fd-4465-a4c2-633bd1739c91" status: 202 len: 0 microversion: 2.1 time: 0.174222 Jul 11 14:23:42.401392 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 474/935] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 11 14:23:42 2022] DELETE /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44/os-volume_attachments/eac7967b-f8fd-4465-a4c2-633bd1739c91 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:23:42.410311 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c747cf7e-7bc2-415d-9dae-61e457f175ac tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:42.411497 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c747cf7e-7bc2-415d-9dae-61e457f175ac tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:42.418606 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c747cf7e-7bc2-415d-9dae-61e457f175ac tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:42.419052 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c747cf7e-7bc2-415d-9dae-61e457f175ac tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:42.420082 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c747cf7e-7bc2-415d-9dae-61e457f175ac tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:42.420544 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c747cf7e-7bc2-415d-9dae-61e457f175ac tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:42.448355 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e5e2e618-511c-42c4-8cf8-0402911465cf tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:42.462150 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e5e2e618-511c-42c4-8cf8-0402911465cf tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:42.463335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c747cf7e-7bc2-415d-9dae-61e457f175ac tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057333 Jul 11 14:23:42.463937 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 475/936] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:23:42 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:23:42.466202 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e5e2e618-511c-42c4-8cf8-0402911465cf tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:42.466202 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e5e2e618-511c-42c4-8cf8-0402911465cf tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.176221 Jul 11 14:23:42.467224 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 462/937] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:42 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:23:43.485292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-43be2bfe-f60d-4c76-9c70-4f96cd1d6742 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:43.485991 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c20d05ee-161e-44a9-b4b2-a32e61979b7b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:43.486406 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-43be2bfe-f60d-4c76-9c70-4f96cd1d6742 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:43.486688 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c20d05ee-161e-44a9-b4b2-a32e61979b7b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:43.493277 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43be2bfe-f60d-4c76-9c70-4f96cd1d6742 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:43.493735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43be2bfe-f60d-4c76-9c70-4f96cd1d6742 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:43.494145 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c20d05ee-161e-44a9-b4b2-a32e61979b7b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:43.494541 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43be2bfe-f60d-4c76-9c70-4f96cd1d6742 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:43.494696 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c20d05ee-161e-44a9-b4b2-a32e61979b7b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:43.495076 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43be2bfe-f60d-4c76-9c70-4f96cd1d6742 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:43.495472 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c20d05ee-161e-44a9-b4b2-a32e61979b7b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:43.495913 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c20d05ee-161e-44a9-b4b2-a32e61979b7b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:43.527466 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-43be2bfe-f60d-4c76-9c70-4f96cd1d6742 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046070 Jul 11 14:23:43.528064 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 476/938] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:23:43 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 14:23:43.595769 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-88fb3b7d-4003-4ad0-96d2-36b765888dff tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:43.596278 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-88fb3b7d-4003-4ad0-96d2-36b765888dff tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:43.603161 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88fb3b7d-4003-4ad0-96d2-36b765888dff tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:43.603840 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88fb3b7d-4003-4ad0-96d2-36b765888dff tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:43.604624 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88fb3b7d-4003-4ad0-96d2-36b765888dff tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:43.605250 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88fb3b7d-4003-4ad0-96d2-36b765888dff tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:43.630955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-88fb3b7d-4003-4ad0-96d2-36b765888dff tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:23:43.643654 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c20d05ee-161e-44a9-b4b2-a32e61979b7b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:43.652232 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c20d05ee-161e-44a9-b4b2-a32e61979b7b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:43.653756 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c20d05ee-161e-44a9-b4b2-a32e61979b7b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:43.654961 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c20d05ee-161e-44a9-b4b2-a32e61979b7b tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.173061 Jul 11 14:23:43.655536 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 463/939] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:43 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:23:43.711768 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-88fb3b7d-4003-4ad0-96d2-36b765888dff tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 204 len: 0 microversion: 2.1 time: 0.119553 Jul 11 14:23:43.712484 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 477/940] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:23:43 2022] DELETE /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 11 14:23:43.721012 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d9cb276f-007e-4752-84e4-f4bc881f0628 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:43.721633 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d9cb276f-007e-4752-84e4-f4bc881f0628 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:43.728405 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d9cb276f-007e-4752-84e4-f4bc881f0628 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:43.728862 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d9cb276f-007e-4752-84e4-f4bc881f0628 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:43.729632 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d9cb276f-007e-4752-84e4-f4bc881f0628 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:43.730070 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d9cb276f-007e-4752-84e4-f4bc881f0628 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:43.860780 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d9cb276f-007e-4752-84e4-f4bc881f0628 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:43.869317 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d9cb276f-007e-4752-84e4-f4bc881f0628 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 200 len: 1680 microversion: 2.1 time: 0.152175 Jul 11 14:23:43.869891 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 464/941] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:43 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:44.626718 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-17c83014-8000-4fd5-a87b-8aef95e377ce req-8d459f62-b13c-4f36-b481-2a260f1dfbd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a20f292-9867-4b58-a3eb-12f153edd3aa", "name": "network-vif-plugged", "status": "completed", "tag": "802d4a9e-0fa0-41e8-876a-385488fc4283"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:23:44.638063 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-17c83014-8000-4fd5-a87b-8aef95e377ce req-8d459f62-b13c-4f36-b481-2a260f1dfbd5 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:44.638302 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-17c83014-8000-4fd5-a87b-8aef95e377ce req-8d459f62-b13c-4f36-b481-2a260f1dfbd5 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:44.651998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-17c83014-8000-4fd5-a87b-8aef95e377ce req-8d459f62-b13c-4f36-b481-2a260f1dfbd5 service nova] Creating event network-vif-plugged:802d4a9e-0fa0-41e8-876a-385488fc4283 for instance 5a20f292-9867-4b58-a3eb-12f153edd3aa on hv-cinder-81914 Jul 11 14:23:44.657568 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-17c83014-8000-4fd5-a87b-8aef95e377ce req-8d459f62-b13c-4f36-b481-2a260f1dfbd5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035472 Jul 11 14:23:44.658810 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 478/942] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:23:44.673141 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-487be7f9-9fed-4b24-ab15-c5425f0a17bd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:44.673770 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-487be7f9-9fed-4b24-ab15-c5425f0a17bd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:44.680822 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-487be7f9-9fed-4b24-ab15-c5425f0a17bd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:44.681257 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-487be7f9-9fed-4b24-ab15-c5425f0a17bd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:44.682048 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-487be7f9-9fed-4b24-ab15-c5425f0a17bd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:44.682523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-487be7f9-9fed-4b24-ab15-c5425f0a17bd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:44.825898 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-487be7f9-9fed-4b24-ab15-c5425f0a17bd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:44.834119 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-487be7f9-9fed-4b24-ab15-c5425f0a17bd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:44.835685 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-487be7f9-9fed-4b24-ab15-c5425f0a17bd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:44.836879 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-487be7f9-9fed-4b24-ab15-c5425f0a17bd tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.167799 Jul 11 14:23:44.837622 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 465/943] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:44 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:23:44.887392 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eb45c396-eb10-4dd9-b13d-8de20f55c0a6 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:44.888100 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eb45c396-eb10-4dd9-b13d-8de20f55c0a6 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:44.894417 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb45c396-eb10-4dd9-b13d-8de20f55c0a6 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:44.894873 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb45c396-eb10-4dd9-b13d-8de20f55c0a6 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:44.896143 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb45c396-eb10-4dd9-b13d-8de20f55c0a6 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:44.896578 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb45c396-eb10-4dd9-b13d-8de20f55c0a6 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:45.105809 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eb45c396-eb10-4dd9-b13d-8de20f55c0a6 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:45.113559 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eb45c396-eb10-4dd9-b13d-8de20f55c0a6 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 200 len: 1680 microversion: 2.1 time: 0.230407 Jul 11 14:23:45.115023 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 479/944] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:44 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 1680 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:45.250847 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-40311e5a-d67f-49df-abe6-534ee16a8880 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:45.251692 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-40311e5a-d67f-49df-abe6-534ee16a8880 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:45.252365 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-7877ca04-6d5a-47ea-a3d3-b06d8f2133d7 req-b1b789ca-d1d6-4e96-925f-280b055d3be2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be66bb60-a0c4-4db8-8eca-61debf0d1604", "tag": "de27be74-eeae-4fd8-9e66-9d465aca8acc"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:23:45.258886 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40311e5a-d67f-49df-abe6-534ee16a8880 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:45.259342 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40311e5a-d67f-49df-abe6-534ee16a8880 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:45.260131 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40311e5a-d67f-49df-abe6-534ee16a8880 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:45.260568 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40311e5a-d67f-49df-abe6-534ee16a8880 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:45.262584 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7877ca04-6d5a-47ea-a3d3-b06d8f2133d7 req-b1b789ca-d1d6-4e96-925f-280b055d3be2 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:45.263164 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7877ca04-6d5a-47ea-a3d3-b06d8f2133d7 req-b1b789ca-d1d6-4e96-925f-280b055d3be2 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:45.275372 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-7877ca04-6d5a-47ea-a3d3-b06d8f2133d7 req-b1b789ca-d1d6-4e96-925f-280b055d3be2 service nova] Creating event network-changed:de27be74-eeae-4fd8-9e66-9d465aca8acc for instance be66bb60-a0c4-4db8-8eca-61debf0d1604 on hv-cinder-81914 Jul 11 14:23:45.281028 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-7877ca04-6d5a-47ea-a3d3-b06d8f2133d7 req-b1b789ca-d1d6-4e96-925f-280b055d3be2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032933 Jul 11 14:23:45.281850 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 480/945] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:23:45.287639 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-40311e5a-d67f-49df-abe6-534ee16a8880 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:23:45.375287 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-40311e5a-d67f-49df-abe6-534ee16a8880 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "DELETE /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 204 len: 0 microversion: 2.1 time: 0.129287 Jul 11 14:23:45.379742 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 466/946] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:23:45 2022] DELETE /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:23:45.388323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3102c077-fb3e-4115-9663-3e14a7a02af6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:45.389096 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3102c077-fb3e-4115-9663-3e14a7a02af6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:45.396610 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3102c077-fb3e-4115-9663-3e14a7a02af6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:45.397227 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3102c077-fb3e-4115-9663-3e14a7a02af6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:45.398228 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3102c077-fb3e-4115-9663-3e14a7a02af6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:45.398507 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3102c077-fb3e-4115-9663-3e14a7a02af6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:45.555432 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3102c077-fb3e-4115-9663-3e14a7a02af6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:45.566386 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3102c077-fb3e-4115-9663-3e14a7a02af6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1576 microversion: 2.1 time: 0.184702 Jul 11 14:23:45.577142 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 481/947] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:45 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1576 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:45.860849 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cc2a63ec-e145-4a64-beee-b65e92f3b1e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:45.861559 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cc2a63ec-e145-4a64-beee-b65e92f3b1e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:45.868471 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc2a63ec-e145-4a64-beee-b65e92f3b1e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:45.868922 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc2a63ec-e145-4a64-beee-b65e92f3b1e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:45.869703 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc2a63ec-e145-4a64-beee-b65e92f3b1e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:45.870140 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc2a63ec-e145-4a64-beee-b65e92f3b1e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:46.006632 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cc2a63ec-e145-4a64-beee-b65e92f3b1e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:46.015365 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cc2a63ec-e145-4a64-beee-b65e92f3b1e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:46.016874 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cc2a63ec-e145-4a64-beee-b65e92f3b1e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:46.018279 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cc2a63ec-e145-4a64-beee-b65e92f3b1e5 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.161577 Jul 11 14:23:46.018850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 467/948] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:45 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:46.133210 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fc20d228-f249-457e-ad61-64a8a5c01e40 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:46.133851 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fc20d228-f249-457e-ad61-64a8a5c01e40 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:46.141131 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc20d228-f249-457e-ad61-64a8a5c01e40 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:46.141587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc20d228-f249-457e-ad61-64a8a5c01e40 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:46.142641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc20d228-f249-457e-ad61-64a8a5c01e40 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:46.143245 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc20d228-f249-457e-ad61-64a8a5c01e40 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:46.289130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fc20d228-f249-457e-ad61-64a8a5c01e40 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:46.298185 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fc20d228-f249-457e-ad61-64a8a5c01e40 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 200 len: 1680 microversion: 2.1 time: 0.169565 Jul 11 14:23:46.299662 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 482/949] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:46 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:46.584426 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3133cd57-3393-49d4-b886-81e6055d6404 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:46.584945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3133cd57-3393-49d4-b886-81e6055d6404 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:46.591086 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3133cd57-3393-49d4-b886-81e6055d6404 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:46.591536 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3133cd57-3393-49d4-b886-81e6055d6404 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:46.592312 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3133cd57-3393-49d4-b886-81e6055d6404 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:46.592750 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3133cd57-3393-49d4-b886-81e6055d6404 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:46.743307 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3133cd57-3393-49d4-b886-81e6055d6404 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:46.750841 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3133cd57-3393-49d4-b886-81e6055d6404 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1576 microversion: 2.1 time: 0.170460 Jul 11 14:23:46.751398 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 468/950] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:46 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:47.040421 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fcfd0d52-8c47-40a2-8785-559a7a81bee8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:47.041036 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fcfd0d52-8c47-40a2-8785-559a7a81bee8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:47.047179 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcfd0d52-8c47-40a2-8785-559a7a81bee8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:47.047616 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcfd0d52-8c47-40a2-8785-559a7a81bee8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:47.048379 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcfd0d52-8c47-40a2-8785-559a7a81bee8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:47.048814 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcfd0d52-8c47-40a2-8785-559a7a81bee8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:47.067282 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:47.315104 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b7c95039-6662-489b-8ae3-1aa7aadcb337 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:47.315765 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b7c95039-6662-489b-8ae3-1aa7aadcb337 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:47.322689 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b7c95039-6662-489b-8ae3-1aa7aadcb337 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:47.323141 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b7c95039-6662-489b-8ae3-1aa7aadcb337 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:47.323925 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b7c95039-6662-489b-8ae3-1aa7aadcb337 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:47.324364 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b7c95039-6662-489b-8ae3-1aa7aadcb337 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:47.328761 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:47.460598 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b7c95039-6662-489b-8ae3-1aa7aadcb337 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:47.468281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b7c95039-6662-489b-8ae3-1aa7aadcb337 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 200 len: 1680 microversion: 2.1 time: 0.157175 Jul 11 14:23:47.468877 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 469/951] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:47 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:23:47.516769 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fcfd0d52-8c47-40a2-8785-559a7a81bee8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:47.525450 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fcfd0d52-8c47-40a2-8785-559a7a81bee8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:47.527018 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fcfd0d52-8c47-40a2-8785-559a7a81bee8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:47.528191 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fcfd0d52-8c47-40a2-8785-559a7a81bee8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.492495 Jul 11 14:23:47.528840 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 483/952] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:47 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:47.768120 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-481d3e1a-8b3e-4864-abdc-b95a3153c02b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:47.768740 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-481d3e1a-8b3e-4864-abdc-b95a3153c02b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:47.775408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-481d3e1a-8b3e-4864-abdc-b95a3153c02b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:47.775937 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-481d3e1a-8b3e-4864-abdc-b95a3153c02b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:47.776719 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-481d3e1a-8b3e-4864-abdc-b95a3153c02b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:47.777159 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-481d3e1a-8b3e-4864-abdc-b95a3153c02b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:47.916531 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-481d3e1a-8b3e-4864-abdc-b95a3153c02b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:47.924093 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-481d3e1a-8b3e-4864-abdc-b95a3153c02b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1576 microversion: 2.1 time: 0.159847 Jul 11 14:23:47.924673 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 470/953] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:47 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:48.496523 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f8190254-eee0-49c1-a07d-4045dc6233be tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:48.497478 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f8190254-eee0-49c1-a07d-4045dc6233be tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:48.545993 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8190254-eee0-49c1-a07d-4045dc6233be tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:48.546769 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8190254-eee0-49c1-a07d-4045dc6233be tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:48.547266 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8190254-eee0-49c1-a07d-4045dc6233be tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:48.547705 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8190254-eee0-49c1-a07d-4045dc6233be tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:48.552241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-af46916a-cd22-44f9-a40f-8a1ca27bb85f req-bf25d0db-621e-48bd-89e4-831fbbc6a528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be66bb60-a0c4-4db8-8eca-61debf0d1604", "name": "network-vif-deleted", "tag": "de27be74-eeae-4fd8-9e66-9d465aca8acc"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:23:48.571202 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-af46916a-cd22-44f9-a40f-8a1ca27bb85f req-bf25d0db-621e-48bd-89e4-831fbbc6a528 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:48.572387 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-af46916a-cd22-44f9-a40f-8a1ca27bb85f req-bf25d0db-621e-48bd-89e4-831fbbc6a528 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:48.588431 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-af46916a-cd22-44f9-a40f-8a1ca27bb85f req-bf25d0db-621e-48bd-89e4-831fbbc6a528 service nova] Creating event network-vif-deleted:de27be74-eeae-4fd8-9e66-9d465aca8acc for instance be66bb60-a0c4-4db8-8eca-61debf0d1604 on hv-cinder-81914 Jul 11 14:23:48.593315 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-af46916a-cd22-44f9-a40f-8a1ca27bb85f req-bf25d0db-621e-48bd-89e4-831fbbc6a528 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052411 Jul 11 14:23:48.594675 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 471/954] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:23:48.601253 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9cbe01a5-9d8e-4e88-a5ed-53a07730cf4e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:48.601938 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9cbe01a5-9d8e-4e88-a5ed-53a07730cf4e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:48.609674 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9cbe01a5-9d8e-4e88-a5ed-53a07730cf4e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:48.610127 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9cbe01a5-9d8e-4e88-a5ed-53a07730cf4e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:48.611095 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9cbe01a5-9d8e-4e88-a5ed-53a07730cf4e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:48.611683 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9cbe01a5-9d8e-4e88-a5ed-53a07730cf4e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:48.666047 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8190254-eee0-49c1-a07d-4045dc6233be tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:48.675816 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f8190254-eee0-49c1-a07d-4045dc6233be tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 200 len: 1613 microversion: 2.1 time: 0.190899 Jul 11 14:23:48.677133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 484/955] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:48 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 1613 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:48.719539 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-8441592d-93ce-47a9-b226-54996792aacf req-4819cad1-7976-41c1-8532-d8d4c53cb728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f166a5e8-f81d-4879-aa18-19c8cf86cd44", "name": "network-vif-deleted", "tag": "8d5ba811-4eec-40ce-8da7-b9d5833c170b"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:23:48.730788 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8441592d-93ce-47a9-b226-54996792aacf req-4819cad1-7976-41c1-8532-d8d4c53cb728 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:48.731788 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8441592d-93ce-47a9-b226-54996792aacf req-4819cad1-7976-41c1-8532-d8d4c53cb728 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:48.752714 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-8441592d-93ce-47a9-b226-54996792aacf req-4819cad1-7976-41c1-8532-d8d4c53cb728 service nova] Creating event network-vif-deleted:8d5ba811-4eec-40ce-8da7-b9d5833c170b for instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 on hv-cinder-81914 Jul 11 14:23:48.760050 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-8441592d-93ce-47a9-b226-54996792aacf req-4819cad1-7976-41c1-8532-d8d4c53cb728 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044054 Jul 11 14:23:48.762744 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 485/956] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:23:48.799215 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9cbe01a5-9d8e-4e88-a5ed-53a07730cf4e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:48.809308 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9cbe01a5-9d8e-4e88-a5ed-53a07730cf4e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:48.810760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9cbe01a5-9d8e-4e88-a5ed-53a07730cf4e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:48.811950 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9cbe01a5-9d8e-4e88-a5ed-53a07730cf4e tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.215969 Jul 11 14:23:48.812737 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 472/957] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:48 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:48.942461 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-002da801-2582-4c47-b56a-a3c7b32a6bc6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:48.943553 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-002da801-2582-4c47-b56a-a3c7b32a6bc6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:48.951605 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-002da801-2582-4c47-b56a-a3c7b32a6bc6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:48.952058 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-002da801-2582-4c47-b56a-a3c7b32a6bc6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:48.952859 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-002da801-2582-4c47-b56a-a3c7b32a6bc6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:48.953293 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-002da801-2582-4c47-b56a-a3c7b32a6bc6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:49.029860 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-002da801-2582-4c47-b56a-a3c7b32a6bc6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:49.039161 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-002da801-2582-4c47-b56a-a3c7b32a6bc6 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1391 microversion: 2.1 time: 0.101716 Jul 11 14:23:49.039765 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 486/958] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:48 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1391 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:49.693047 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-42084c50-9161-4788-8620-1150d0f29816 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:49.693658 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-42084c50-9161-4788-8620-1150d0f29816 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:49.700548 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42084c50-9161-4788-8620-1150d0f29816 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:49.701106 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42084c50-9161-4788-8620-1150d0f29816 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:49.701969 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42084c50-9161-4788-8620-1150d0f29816 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:49.702641 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42084c50-9161-4788-8620-1150d0f29816 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:49.720935 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-42084c50-9161-4788-8620-1150d0f29816 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] HTTP exception thrown: Instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 could not be found. Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-42084c50-9161-4788-8620-1150d0f29816 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Request method failure captured: Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 HTTP/1.1 Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDGazgesZ8gm-xkGX3sogYiEnmE9DbvhKeeh7tJMTX6Y58vVTm48pJ0qqerjCEqeh3Rk7vIu5Mf6TPbuSudm7DddzzEsc9NjqbILyr7XHvKKA7DT_oLLVUIhEbYpW0g3TYtb5AJyNnSid_YkDT-vH95HrvzbM46bM90tJC5hswTE0Jw Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:23:49.723647 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:23:49.725408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:23:49.725408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:23:49.725408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:23:49.725408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:23:49.725408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:23:49.725408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:23:49.725408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:23:49.725408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 5bbea49c1a55481c9995f04f2e9b8618 Jul 11 14:23:49.725408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:23:49.725408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:23:49.725408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 could not be found. Jul 11 14:23:49.725408 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': 'f166a5e8-f81d-4879-aa18-19c8cf86cd44'} Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 could not be found. Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:23:49.726368 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:23:49.727932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:23:49.727932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:23:49.727932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:23:49.727932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:23:49.727932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:23:49.727932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:23:49.727932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:23:49.727932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 could not be found. Jul 11 14:23:49.727932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:23:49.727932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:23:49.727932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:23:49.727932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:23:49.727932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:23:49.727932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:23:49.727932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:23:49.727932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:23:49.727932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 could not be found. Jul 11 14:23:49.727932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:23:49.729313 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-42084c50-9161-4788-8620-1150d0f29816 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Returning 404 to user: Instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:23:49.729313 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-42084c50-9161-4788-8620-1150d0f29816 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 404 len: 111 microversion: 2.1 time: 0.037478 Jul 11 14:23:49.729313 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 473/959] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:49 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:23:49.735888 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cdfa1671-5b5c-4b36-bb89-cccbd75ee963 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '.version_select at 0x7fc976ba6b80>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:49.759351 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cdfa1671-5b5c-4b36-bb89-cccbd75ee963 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-938293597" status: 202 len: 0 microversion: 2.1 time: 0.027463 Jul 11 14:23:49.760019 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 487/960] 10.222.0.66 () {58 vars in 1217 bytes} [Mon Jul 11 14:23:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-938293597 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 14:23:49.831451 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b90a0374-48d7-4888-9824-e47ede1ddedb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:49.832298 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b90a0374-48d7-4888-9824-e47ede1ddedb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:49.839209 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b90a0374-48d7-4888-9824-e47ede1ddedb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:49.840046 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b90a0374-48d7-4888-9824-e47ede1ddedb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:49.841101 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b90a0374-48d7-4888-9824-e47ede1ddedb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:49.841784 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b90a0374-48d7-4888-9824-e47ede1ddedb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:50.008208 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b90a0374-48d7-4888-9824-e47ede1ddedb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:50.020382 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b90a0374-48d7-4888-9824-e47ede1ddedb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:50.021880 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b90a0374-48d7-4888-9824-e47ede1ddedb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:50.029556 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b90a0374-48d7-4888-9824-e47ede1ddedb tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1732 microversion: 2.20 time: 0.196524 Jul 11 14:23:50.031361 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 474/961] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:49 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1732 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:50.057304 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-00fa6903-86d4-4622-a887-10ea3e56a0f9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:50.057946 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-00fa6903-86d4-4622-a887-10ea3e56a0f9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:50.064488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00fa6903-86d4-4622-a887-10ea3e56a0f9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:50.064961 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00fa6903-86d4-4622-a887-10ea3e56a0f9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:50.065744 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00fa6903-86d4-4622-a887-10ea3e56a0f9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:50.066202 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00fa6903-86d4-4622-a887-10ea3e56a0f9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:50.106197 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00fa6903-86d4-4622-a887-10ea3e56a0f9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:50.106701 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00fa6903-86d4-4622-a887-10ea3e56a0f9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:50.107159 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-00fa6903-86d4-4622-a887-10ea3e56a0f9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lazy-loading 'fault' on Instance uuid be66bb60-a0c4-4db8-8eca-61debf0d1604 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:23:50.191581 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-00fa6903-86d4-4622-a887-10ea3e56a0f9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5383a1d1bec34094a1889a86d87a88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da67a5ec9194e7bad1eb52c45a584bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:50.200007 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-00fa6903-86d4-4622-a887-10ea3e56a0f9 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 200 len: 1185 microversion: 2.1 time: 0.146876 Jul 11 14:23:50.200855 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 488/962] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:50 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 1185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:50.468669 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bc2aa35c-c0d0-4b77-939d-e64e9d3e27f9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Action: 'create', calling method: .version_select at 0x7fc976be1550>, body: {"keypair": {"name": "tempest-keypair-720695196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA87Mygzv/b2YF5wqlMfOHfw4FRALZY6daUUTjdzhtHSy5w3lmFbo8ibLIxkmu3TqEY5vlJ4H+mAR037TESJCO20M/uDWp1MkSIUA8prwzI7MiLm2S5CQgnmrPYHP1anTg=="}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:23:50.483531 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-bc2aa35c-c0d0-4b77-939d-e64e9d3e27f9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Getting quotas for project 30c5e99c9761441fbad367a0bb8e1e66. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:23:50.487324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-bc2aa35c-c0d0-4b77-939d-e64e9d3e27f9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Getting quotas for user 5bbea49c1a55481c9995f04f2e9b8618 and project 30c5e99c9761441fbad367a0bb8e1e66. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:23:50.511199 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bc2aa35c-c0d0-4b77-939d-e64e9d3e27f9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046412 Jul 11 14:23:50.511804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 475/963] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 11 14:23:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:23:51.050436 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e94dd68e-ea40-468f-a285-c9042796d054 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:51.051172 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e94dd68e-ea40-468f-a285-c9042796d054 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:51.058007 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e94dd68e-ea40-468f-a285-c9042796d054 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:51.058562 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e94dd68e-ea40-468f-a285-c9042796d054 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:51.059430 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e94dd68e-ea40-468f-a285-c9042796d054 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:51.059908 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e94dd68e-ea40-468f-a285-c9042796d054 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:51.219090 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c4d258dd-7b98-4c61-b178-5d2059ba431c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:51.220287 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c4d258dd-7b98-4c61-b178-5d2059ba431c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: be66bb60-a0c4-4db8-8eca-61debf0d1604] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:51.227233 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c4d258dd-7b98-4c61-b178-5d2059ba431c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:51.227680 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c4d258dd-7b98-4c61-b178-5d2059ba431c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:51.228468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c4d258dd-7b98-4c61-b178-5d2059ba431c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:51.228904 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c4d258dd-7b98-4c61-b178-5d2059ba431c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:51.243762 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-c4d258dd-7b98-4c61-b178-5d2059ba431c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] HTTP exception thrown: Instance be66bb60-a0c4-4db8-8eca-61debf0d1604 could not be found. Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c4d258dd-7b98-4c61-b178-5d2059ba431c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Request method failure captured: Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 HTTP/1.1 Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDCWtrVPQbCUpon-pQ1xYhol8hBL6rk3TSkFxcaTbkECgG6FsCfZ2TYnTfbWTAw4B3A0QrIHkMoyrs8lZW3RyaBx-cBGYTGvlonbC5nfUHo8rg37cEdW1Xv9NfrPtPm332_ZshUaTRn39MebhPgRYP1k3wxtyWEO1b2zP9eJb5_Hd-0 Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 8da67a5ec9194e7bad1eb52c45a584bf Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-TestVolumeBootPattern-1971221977 Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:23:51.245324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:23:51.246996 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:23:51.246996 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-TestVolumeBootPattern-1971221977 Jul 11 14:23:51.246996 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 8da67a5ec9194e7bad1eb52c45a584bf Jul 11 14:23:51.246996 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-TestVolumeBootPattern-1971221977 Jul 11 14:23:51.246996 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-TestVolumeBootPattern-1971221977-project Jul 11 14:23:51.246996 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:23:51.246996 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:23:51.246996 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 5383a1d1bec34094a1889a86d87a88b5 Jul 11 14:23:51.246996 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-TestVolumeBootPattern-1971221977-project Jul 11 14:23:51.246996 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:23:51.246996 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance be66bb60-a0c4-4db8-8eca-61debf0d1604 could not be found. Jul 11 14:23:51.246996 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': 'be66bb60-a0c4-4db8-8eca-61debf0d1604'} Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be66bb60-a0c4-4db8-8eca-61debf0d1604 could not be found. Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:23:51.247945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:23:51.249468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:23:51.249468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:23:51.249468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:23:51.249468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:23:51.249468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:23:51.249468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:23:51.249468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:23:51.249468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be66bb60-a0c4-4db8-8eca-61debf0d1604 could not be found. Jul 11 14:23:51.249468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:23:51.249468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:23:51.249468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:23:51.249468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:23:51.249468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:23:51.249468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:23:51.249468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:23:51.249468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:23:51.249468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be66bb60-a0c4-4db8-8eca-61debf0d1604 could not be found. Jul 11 14:23:51.249468 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:23:51.250898 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c4d258dd-7b98-4c61-b178-5d2059ba431c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Returning 404 to user: Instance be66bb60-a0c4-4db8-8eca-61debf0d1604 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:23:51.250898 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c4d258dd-7b98-4c61-b178-5d2059ba431c tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604" status: 404 len: 111 microversion: 2.1 time: 0.032333 Jul 11 14:23:51.250898 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 476/964] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:51 2022] GET /compute/v2.1/servers/be66bb60-a0c4-4db8-8eca-61debf0d1604 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 14:23:51.270517 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e94dd68e-ea40-468f-a285-c9042796d054 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:51.279008 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e94dd68e-ea40-468f-a285-c9042796d054 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:51.280631 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e94dd68e-ea40-468f-a285-c9042796d054 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:51.281904 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e94dd68e-ea40-468f-a285-c9042796d054 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1719 microversion: 2.20 time: 0.235543 Jul 11 14:23:51.282604 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 489/965] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:23:51 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1719 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:23:51.849282 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1c68786c-1b58-4500-bdf8-11854b99e3a7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1418313625", "imageRef": "67874ac7-fac8-4d6d-9cd1-9091ecb957b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "082c1f0c-e3fc-4cfb-9f28-88c9d2f15bb4"}], "security_groups": [{"name": "tempest-securitygroup--1586370549"}], "key_name": "tempest-keypair-720695196", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:23:51.977479 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-886616f9-6c62-4e1b-af11-c8313d69f83b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:51.978135 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-886616f9-6c62-4e1b-af11-c8313d69f83b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:51.984328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-886616f9-6c62-4e1b-af11-c8313d69f83b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:51.984865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-886616f9-6c62-4e1b-af11-c8313d69f83b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:51.985712 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-886616f9-6c62-4e1b-af11-c8313d69f83b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:51.986261 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-886616f9-6c62-4e1b-af11-c8313d69f83b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:51.993915 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-1c68786c-1b58-4500-bdf8-11854b99e3a7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] validate_networks() for [('082c1f0c-e3fc-4cfb-9f28-88c9d2f15bb4', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:23:52.001445 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-886616f9-6c62-4e1b-af11-c8313d69f83b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] HTTP exception thrown: Instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff could not be found. Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-886616f9-6c62-4e1b-af11-c8313d69f83b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Request method failure captured: Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff HTTP/1.1 Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDCWtrVPQbCUpon-pQ1xYhol8hBL6rk3TSkFxcaTbkECgG6FsCfZ2TYnTfbWTAw4B3A0QrIHkMoyrs8lZW3RyaBx-cBGYTGvlonbC5nfUHo8rg37cEdW1Xv9NfrPtPm332_ZshUaTRn39MebhPgRYP1k3wxtyWEO1b2zP9eJb5_Hd-0 Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 8da67a5ec9194e7bad1eb52c45a584bf Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestVolumeBootPattern-1971221977 Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:23:52.003168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:23:52.004818 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:23:52.004818 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestVolumeBootPattern-1971221977 Jul 11 14:23:52.004818 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 8da67a5ec9194e7bad1eb52c45a584bf Jul 11 14:23:52.004818 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestVolumeBootPattern-1971221977 Jul 11 14:23:52.004818 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-TestVolumeBootPattern-1971221977-project Jul 11 14:23:52.004818 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:23:52.004818 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:23:52.004818 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 5383a1d1bec34094a1889a86d87a88b5 Jul 11 14:23:52.004818 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestVolumeBootPattern-1971221977-project Jul 11 14:23:52.004818 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:23:52.004818 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff could not be found. Jul 11 14:23:52.004818 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': '7530cb60-25fa-4960-b9e9-00c48a4a7eff'} Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff could not be found. Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:23:52.005694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff could not be found. Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff could not be found. Jul 11 14:23:52.007156 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:23:52.008634 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-886616f9-6c62-4e1b-af11-c8313d69f83b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Returning 404 to user: Instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:23:52.008634 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-886616f9-6c62-4e1b-af11-c8313d69f83b tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 404 len: 111 microversion: 2.1 time: 0.031266 Jul 11 14:23:52.008634 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 490/966] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:23:51 2022] DELETE /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 14:23:52.013627 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-86609a71-131c-4855-8147-bce1e1a33145 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:52.014265 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-86609a71-131c-4855-8147-bce1e1a33145 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] [instance: 7530cb60-25fa-4960-b9e9-00c48a4a7eff] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:52.020638 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86609a71-131c-4855-8147-bce1e1a33145 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:52.021165 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86609a71-131c-4855-8147-bce1e1a33145 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:52.021904 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86609a71-131c-4855-8147-bce1e1a33145 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:52.022465 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86609a71-131c-4855-8147-bce1e1a33145 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:52.037829 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-86609a71-131c-4855-8147-bce1e1a33145 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] HTTP exception thrown: Instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff could not be found. Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-86609a71-131c-4855-8147-bce1e1a33145 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Request method failure captured: Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff HTTP/1.1 Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDCWtrVPQbCUpon-pQ1xYhol8hBL6rk3TSkFxcaTbkECgG6FsCfZ2TYnTfbWTAw4B3A0QrIHkMoyrs8lZW3RyaBx-cBGYTGvlonbC5nfUHo8rg37cEdW1Xv9NfrPtPm332_ZshUaTRn39MebhPgRYP1k3wxtyWEO1b2zP9eJb5_Hd-0 Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 8da67a5ec9194e7bad1eb52c45a584bf Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestVolumeBootPattern-1971221977 Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:23:52.039335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:23:52.040936 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8da67a5ec9194e7bad1eb52c45a584bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:23:52.040936 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestVolumeBootPattern-1971221977 Jul 11 14:23:52.040936 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 8da67a5ec9194e7bad1eb52c45a584bf Jul 11 14:23:52.040936 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestVolumeBootPattern-1971221977 Jul 11 14:23:52.040936 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-TestVolumeBootPattern-1971221977-project Jul 11 14:23:52.040936 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:23:52.040936 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:23:52.040936 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 5383a1d1bec34094a1889a86d87a88b5 Jul 11 14:23:52.040936 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestVolumeBootPattern-1971221977-project Jul 11 14:23:52.040936 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:23:52.040936 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff could not be found. Jul 11 14:23:52.040936 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': '7530cb60-25fa-4960-b9e9-00c48a4a7eff'} Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff could not be found. Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:23:52.041843 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:23:52.043130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:23:52.043130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:23:52.043130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:23:52.043130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:23:52.043130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:23:52.043130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:23:52.043130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:23:52.043130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff could not be found. Jul 11 14:23:52.043130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:23:52.043130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:23:52.043130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:23:52.043130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:23:52.043130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:23:52.043130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:23:52.043130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:23:52.043130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:23:52.043130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff could not be found. Jul 11 14:23:52.043130 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:23:52.044304 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-86609a71-131c-4855-8147-bce1e1a33145 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Returning 404 to user: Instance 7530cb60-25fa-4960-b9e9-00c48a4a7eff could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:23:52.044304 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-86609a71-131c-4855-8147-bce1e1a33145 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff" status: 404 len: 111 microversion: 2.1 time: 0.030765 Jul 11 14:23:52.044304 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 491/967] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:52 2022] GET /compute/v2.1/servers/7530cb60-25fa-4960-b9e9-00c48a4a7eff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:23:52.190343 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:52.405609 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-1c68786c-1b58-4500-bdf8-11854b99e3a7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:23:52.406267 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-1c68786c-1b58-4500-bdf8-11854b99e3a7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:23:52.406523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-1c68786c-1b58-4500-bdf8-11854b99e3a7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:23:52.406927 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-1c68786c-1b58-4500-bdf8-11854b99e3a7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:23:52.407361 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-1c68786c-1b58-4500-bdf8-11854b99e3a7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:23:52.416991 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1c68786c-1b58-4500-bdf8-11854b99e3a7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:52.417433 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1c68786c-1b58-4500-bdf8-11854b99e3a7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:52.418257 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1c68786c-1b58-4500-bdf8-11854b99e3a7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:52.418682 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1c68786c-1b58-4500-bdf8-11854b99e3a7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:52.435927 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-1c68786c-1b58-4500-bdf8-11854b99e3a7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Getting quotas for project 30c5e99c9761441fbad367a0bb8e1e66. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:23:52.440292 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-1c68786c-1b58-4500-bdf8-11854b99e3a7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Getting quotas for user 5bbea49c1a55481c9995f04f2e9b8618 and project 30c5e99c9761441fbad367a0bb8e1e66. Resources: {'instances', 'cores', 'ram'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:23:52.451238 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1c68786c-1b58-4500-bdf8-11854b99e3a7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:23:52.453478 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1c68786c-1b58-4500-bdf8-11854b99e3a7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67874ac7-fac8-4d6d-9cd1-9091ecb957b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:23:52.499884 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1c68786c-1b58-4500-bdf8-11854b99e3a7 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.655339 Jul 11 14:23:52.504957 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 477/968] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:23:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 11 14:23:52.510807 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aee10348-37dc-45e8-a384-a2c74cd91247 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:52.511431 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aee10348-37dc-45e8-a384-a2c74cd91247 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:52.513866 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:52.568662 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aee10348-37dc-45e8-a384-a2c74cd91247 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:52.575955 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aee10348-37dc-45e8-a384-a2c74cd91247 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78" status: 200 len: 1241 microversion: 2.1 time: 0.068997 Jul 11 14:23:52.576568 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 492/969] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:52 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:53.343815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6017364c-d173-4310-9187-c205d2283cc5 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] Calling method '.version_select at 0x7fc976a52ee0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:53.364415 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6017364c-d173-4310-9187-c205d2283cc5 tempest-TestVolumeBootPattern-1971221977 tempest-TestVolumeBootPattern-1971221977-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2127391203" status: 202 len: 0 microversion: 2.1 time: 0.024797 Jul 11 14:23:53.364959 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 478/970] 10.222.0.66 () {58 vars in 1262 bytes} [Mon Jul 11 14:23:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2127391203 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:23:53.593123 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-930f4d08-ac11-492d-831c-a473e41fec00 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:53.594476 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-930f4d08-ac11-492d-831c-a473e41fec00 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:53.606003 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-930f4d08-ac11-492d-831c-a473e41fec00 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:53.606705 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-930f4d08-ac11-492d-831c-a473e41fec00 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:53.607612 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-930f4d08-ac11-492d-831c-a473e41fec00 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:53.608231 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-930f4d08-ac11-492d-831c-a473e41fec00 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:53.693788 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-930f4d08-ac11-492d-831c-a473e41fec00 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:53.703967 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-930f4d08-ac11-492d-831c-a473e41fec00 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78" status: 200 len: 1311 microversion: 2.1 time: 0.114982 Jul 11 14:23:53.704857 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 493/971] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:53 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:54.728714 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-721488ac-bda7-4512-9e7e-5745b6e742ac tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:54.729345 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-721488ac-bda7-4512-9e7e-5745b6e742ac tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:54.739595 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-721488ac-bda7-4512-9e7e-5745b6e742ac tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:54.740295 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-721488ac-bda7-4512-9e7e-5745b6e742ac tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:54.741259 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-721488ac-bda7-4512-9e7e-5745b6e742ac tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:54.742605 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-721488ac-bda7-4512-9e7e-5745b6e742ac tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:54.980556 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-721488ac-bda7-4512-9e7e-5745b6e742ac tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:54.989180 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-721488ac-bda7-4512-9e7e-5745b6e742ac tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78" status: 200 len: 1367 microversion: 2.1 time: 0.264843 Jul 11 14:23:54.990480 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 479/972] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:54 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:23:55.296828 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-25dd9c28-3c88-47d7-9cb3-2a68042bb6cb req-ad3a67da-b8f4-46ed-8ce4-80dd345820e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1fe8acf-4baf-4413-b971-4c7f2e757f78", "tag": "d97c6a94-27eb-4401-99b9-8acb19c02474"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:23:55.316823 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-25dd9c28-3c88-47d7-9cb3-2a68042bb6cb req-ad3a67da-b8f4-46ed-8ce4-80dd345820e1 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:55.317389 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-25dd9c28-3c88-47d7-9cb3-2a68042bb6cb req-ad3a67da-b8f4-46ed-8ce4-80dd345820e1 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:55.336893 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-25dd9c28-3c88-47d7-9cb3-2a68042bb6cb req-ad3a67da-b8f4-46ed-8ce4-80dd345820e1 service nova] Creating event network-changed:d97c6a94-27eb-4401-99b9-8acb19c02474 for instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 on hv-cinder-81914 Jul 11 14:23:55.344621 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-25dd9c28-3c88-47d7-9cb3-2a68042bb6cb req-ad3a67da-b8f4-46ed-8ce4-80dd345820e1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057116 Jul 11 14:23:55.345253 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 494/973] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:23:56.008162 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e6b66f4b-da3f-411a-8e5c-6e55393d1996 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:56.009766 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e6b66f4b-da3f-411a-8e5c-6e55393d1996 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:56.017861 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e6b66f4b-da3f-411a-8e5c-6e55393d1996 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:56.018365 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e6b66f4b-da3f-411a-8e5c-6e55393d1996 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:56.019150 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e6b66f4b-da3f-411a-8e5c-6e55393d1996 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:56.019583 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e6b66f4b-da3f-411a-8e5c-6e55393d1996 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:56.232495 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e6b66f4b-da3f-411a-8e5c-6e55393d1996 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:56.240815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e6b66f4b-da3f-411a-8e5c-6e55393d1996 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78" status: 200 len: 1367 microversion: 2.1 time: 0.237319 Jul 11 14:23:56.241490 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 480/974] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:56 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:57.262413 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-629d3567-5d1a-4077-ad3d-1e11e2690b62 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:57.263123 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-629d3567-5d1a-4077-ad3d-1e11e2690b62 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:57.269444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-629d3567-5d1a-4077-ad3d-1e11e2690b62 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:57.269900 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-629d3567-5d1a-4077-ad3d-1e11e2690b62 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:57.271462 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-629d3567-5d1a-4077-ad3d-1e11e2690b62 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:57.271942 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-629d3567-5d1a-4077-ad3d-1e11e2690b62 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:57.540951 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-629d3567-5d1a-4077-ad3d-1e11e2690b62 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:57.548527 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-629d3567-5d1a-4077-ad3d-1e11e2690b62 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78" status: 200 len: 1367 microversion: 2.1 time: 0.290946 Jul 11 14:23:57.549212 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 495/975] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:57 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:58.566563 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e678aa60-fb4b-4530-8edd-0344ae6133e9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:58.567980 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e678aa60-fb4b-4530-8edd-0344ae6133e9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:58.576461 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e678aa60-fb4b-4530-8edd-0344ae6133e9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:58.577255 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e678aa60-fb4b-4530-8edd-0344ae6133e9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:58.578116 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e678aa60-fb4b-4530-8edd-0344ae6133e9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:58.578645 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e678aa60-fb4b-4530-8edd-0344ae6133e9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:58.720161 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e678aa60-fb4b-4530-8edd-0344ae6133e9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:58.731879 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e678aa60-fb4b-4530-8edd-0344ae6133e9 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78" status: 200 len: 1367 microversion: 2.1 time: 0.169443 Jul 11 14:23:58.732519 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 481/976] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:58 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:23:59.749808 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7cd3f4f2-317c-4efa-9488-c6f4b90bdf39 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:23:59.750455 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7cd3f4f2-317c-4efa-9488-c6f4b90bdf39 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:23:59.759090 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cd3f4f2-317c-4efa-9488-c6f4b90bdf39 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:59.759536 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cd3f4f2-317c-4efa-9488-c6f4b90bdf39 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:59.760514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cd3f4f2-317c-4efa-9488-c6f4b90bdf39 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:23:59.760947 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cd3f4f2-317c-4efa-9488-c6f4b90bdf39 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:23:59.925924 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7cd3f4f2-317c-4efa-9488-c6f4b90bdf39 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:23:59.936500 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7cd3f4f2-317c-4efa-9488-c6f4b90bdf39 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78" status: 200 len: 1367 microversion: 2.1 time: 0.190096 Jul 11 14:23:59.936886 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 496/977] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:23:59 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:24:00.956982 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-864a2846-ffeb-45b0-907f-c7b33dfc1b68 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:00.957560 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-864a2846-ffeb-45b0-907f-c7b33dfc1b68 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:00.964513 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-864a2846-ffeb-45b0-907f-c7b33dfc1b68 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:00.965183 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-864a2846-ffeb-45b0-907f-c7b33dfc1b68 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:00.965964 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-864a2846-ffeb-45b0-907f-c7b33dfc1b68 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:00.966582 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-864a2846-ffeb-45b0-907f-c7b33dfc1b68 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:00.978121 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-43ecd6a3-e3c8-412e-8d7a-987c4b361831 req-8d4f024b-e344-414a-89b0-493396b08bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1fe8acf-4baf-4413-b971-4c7f2e757f78", "name": "network-vif-plugged", "status": "completed", "tag": "d97c6a94-27eb-4401-99b9-8acb19c02474"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:24:00.987714 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-43ecd6a3-e3c8-412e-8d7a-987c4b361831 req-8d4f024b-e344-414a-89b0-493396b08bea service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:00.988508 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-43ecd6a3-e3c8-412e-8d7a-987c4b361831 req-8d4f024b-e344-414a-89b0-493396b08bea service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:01.005617 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-43ecd6a3-e3c8-412e-8d7a-987c4b361831 req-8d4f024b-e344-414a-89b0-493396b08bea service nova] Creating event network-vif-plugged:d97c6a94-27eb-4401-99b9-8acb19c02474 for instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 on hv-cinder-81914 Jul 11 14:24:01.012493 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-43ecd6a3-e3c8-412e-8d7a-987c4b361831 req-8d4f024b-e344-414a-89b0-493396b08bea service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116948 Jul 11 14:24:01.017351 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 482/978] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:24:01.134082 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-864a2846-ffeb-45b0-907f-c7b33dfc1b68 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:01.142755 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-864a2846-ffeb-45b0-907f-c7b33dfc1b68 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78" status: 200 len: 1367 microversion: 2.1 time: 0.190420 Jul 11 14:24:01.143578 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 497/979] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:24:00 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:24:02.163395 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-53b35176-b141-4da5-afae-1a19753d48b2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:02.164123 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-53b35176-b141-4da5-afae-1a19753d48b2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:02.171156 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-53b35176-b141-4da5-afae-1a19753d48b2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:02.171611 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-53b35176-b141-4da5-afae-1a19753d48b2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:02.172403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-53b35176-b141-4da5-afae-1a19753d48b2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:02.172847 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-53b35176-b141-4da5-afae-1a19753d48b2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:02.323900 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-53b35176-b141-4da5-afae-1a19753d48b2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:02.331700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-53b35176-b141-4da5-afae-1a19753d48b2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78" status: 200 len: 1367 microversion: 2.1 time: 0.174329 Jul 11 14:24:02.332460 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 483/980] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:24:02 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:24:03.349290 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-36d2f46f-7762-4753-80ea-a33dbf65ac7e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:03.349897 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-36d2f46f-7762-4753-80ea-a33dbf65ac7e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:03.352301 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:03.357900 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36d2f46f-7762-4753-80ea-a33dbf65ac7e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:03.358406 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36d2f46f-7762-4753-80ea-a33dbf65ac7e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:03.359169 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36d2f46f-7762-4753-80ea-a33dbf65ac7e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:03.359596 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36d2f46f-7762-4753-80ea-a33dbf65ac7e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:03.492213 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-36d2f46f-7762-4753-80ea-a33dbf65ac7e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:03.500003 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-36d2f46f-7762-4753-80ea-a33dbf65ac7e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78" status: 200 len: 1558 microversion: 2.1 time: 0.154649 Jul 11 14:24:03.500619 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 498/981] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:24:03 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:24:03.516832 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8ea56e91-5f79-4416-86d9-fdbc2259d287 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:03.517333 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8ea56e91-5f79-4416-86d9-fdbc2259d287 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:03.519959 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:03.520622 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=10 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:03.526922 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ea56e91-5f79-4416-86d9-fdbc2259d287 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:03.527376 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ea56e91-5f79-4416-86d9-fdbc2259d287 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:03.528156 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ea56e91-5f79-4416-86d9-fdbc2259d287 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:03.528598 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ea56e91-5f79-4416-86d9-fdbc2259d287 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:03.605419 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8ea56e91-5f79-4416-86d9-fdbc2259d287 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092422 Jul 11 14:24:03.606022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 484/982] 10.222.0.66 () {58 vars in 1274 bytes} [Mon Jul 11 14:24:03 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:24:04.546092 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-7fe32415-82f9-4007-a045-a85c9255b8fe req-8fc15c18-6f37-4809-9c81-8741de6c06a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1fe8acf-4baf-4413-b971-4c7f2e757f78", "tag": "d97c6a94-27eb-4401-99b9-8acb19c02474"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:24:04.557111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7fe32415-82f9-4007-a045-a85c9255b8fe req-8fc15c18-6f37-4809-9c81-8741de6c06a8 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:04.557588 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7fe32415-82f9-4007-a045-a85c9255b8fe req-8fc15c18-6f37-4809-9c81-8741de6c06a8 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:04.570114 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-7fe32415-82f9-4007-a045-a85c9255b8fe req-8fc15c18-6f37-4809-9c81-8741de6c06a8 service nova] Creating event network-changed:d97c6a94-27eb-4401-99b9-8acb19c02474 for instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 on hv-cinder-81914 Jul 11 14:24:04.575781 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-7fe32415-82f9-4007-a045-a85c9255b8fe req-8fc15c18-6f37-4809-9c81-8741de6c06a8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033488 Jul 11 14:24:04.577381 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 499/983] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:24:24.672746 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:24.673586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=60 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:24.678526 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-453f5129-1e63-43a3-8edb-0e76478919f8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:24.679439 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-453f5129-1e63-43a3-8edb-0e76478919f8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:24.686806 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-453f5129-1e63-43a3-8edb-0e76478919f8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:24.687244 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-453f5129-1e63-43a3-8edb-0e76478919f8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:24.688002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-453f5129-1e63-43a3-8edb-0e76478919f8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:24.688434 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-453f5129-1e63-43a3-8edb-0e76478919f8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:24.720180 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-453f5129-1e63-43a3-8edb-0e76478919f8 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048676 Jul 11 14:24:24.720731 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 485/984] 10.222.0.66 () {60 vars in 1342 bytes} [Mon Jul 11 14:24:24 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:24:24.775844 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=17 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:24.776587 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=69 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:24.780703 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-498b3046-3a99-44ba-9d50-f2e5ed6742cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:24.781290 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-498b3046-3a99-44ba-9d50-f2e5ed6742cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:24.788399 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-498b3046-3a99-44ba-9d50-f2e5ed6742cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:24.788851 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-498b3046-3a99-44ba-9d50-f2e5ed6742cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:24.789628 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-498b3046-3a99-44ba-9d50-f2e5ed6742cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:24.790072 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-498b3046-3a99-44ba-9d50-f2e5ed6742cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:24.818275 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-498b3046-3a99-44ba-9d50-f2e5ed6742cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:24:24.895128 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-498b3046-3a99-44ba-9d50-f2e5ed6742cc tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 204 len: 0 microversion: 2.20 time: 0.120180 Jul 11 14:24:24.895814 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 500/985] 10.222.0.66 () {60 vars in 1279 bytes} [Mon Jul 11 14:24:24 2022] DELETE /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 11 14:24:24.904087 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-44aa2f1b-d21c-467d-abe5-38dcce94daef tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:24.904698 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-44aa2f1b-d21c-467d-abe5-38dcce94daef tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:24.911603 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-44aa2f1b-d21c-467d-abe5-38dcce94daef tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:24.912062 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-44aa2f1b-d21c-467d-abe5-38dcce94daef tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:24.912833 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-44aa2f1b-d21c-467d-abe5-38dcce94daef tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:24.913269 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-44aa2f1b-d21c-467d-abe5-38dcce94daef tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:25.051249 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-44aa2f1b-d21c-467d-abe5-38dcce94daef tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:25.060381 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-44aa2f1b-d21c-467d-abe5-38dcce94daef tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:25.061884 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-44aa2f1b-d21c-467d-abe5-38dcce94daef tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:25.063121 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-44aa2f1b-d21c-467d-abe5-38dcce94daef tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1725 microversion: 2.20 time: 0.162950 Jul 11 14:24:25.063687 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 486/986] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:24:24 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:24:26.083045 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2ec3f69f-214d-4e3e-aac9-916917ede525 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:26.083716 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2ec3f69f-214d-4e3e-aac9-916917ede525 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:26.090099 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ec3f69f-214d-4e3e-aac9-916917ede525 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:26.090571 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ec3f69f-214d-4e3e-aac9-916917ede525 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:26.091340 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ec3f69f-214d-4e3e-aac9-916917ede525 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:26.091764 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ec3f69f-214d-4e3e-aac9-916917ede525 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:26.227109 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2ec3f69f-214d-4e3e-aac9-916917ede525 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:26.235169 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2ec3f69f-214d-4e3e-aac9-916917ede525 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:26.236690 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2ec3f69f-214d-4e3e-aac9-916917ede525 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:26.237869 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2ec3f69f-214d-4e3e-aac9-916917ede525 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1725 microversion: 2.20 time: 0.160261 Jul 11 14:24:26.238566 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 501/987] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:24:26 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:24:27.257716 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4f7dce8f-d9a6-4cf3-a9bc-583a6028f429 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:27.258371 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4f7dce8f-d9a6-4cf3-a9bc-583a6028f429 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:27.265252 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f7dce8f-d9a6-4cf3-a9bc-583a6028f429 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:27.265695 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f7dce8f-d9a6-4cf3-a9bc-583a6028f429 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:27.266512 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f7dce8f-d9a6-4cf3-a9bc-583a6028f429 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:27.266951 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f7dce8f-d9a6-4cf3-a9bc-583a6028f429 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:27.407376 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4f7dce8f-d9a6-4cf3-a9bc-583a6028f429 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:27.416179 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4f7dce8f-d9a6-4cf3-a9bc-583a6028f429 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:27.417703 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4f7dce8f-d9a6-4cf3-a9bc-583a6028f429 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '999bc8975c43406c838e5c4bb2af1e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:27.418924 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4f7dce8f-d9a6-4cf3-a9bc-583a6028f429 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 200 len: 1725 microversion: 2.20 time: 0.165860 Jul 11 14:24:27.419490 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 487/988] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:24:27 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:24:27.962293 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-c4bf4d4d-cc07-424c-bbf9-93495e9120db req-ddf175fb-1afe-4e84-a0b1-86e835790f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a20f292-9867-4b58-a3eb-12f153edd3aa", "name": "network-vif-deleted", "tag": "802d4a9e-0fa0-41e8-876a-385488fc4283"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:24:27.976734 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c4bf4d4d-cc07-424c-bbf9-93495e9120db req-ddf175fb-1afe-4e84-a0b1-86e835790f4b service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:27.977305 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c4bf4d4d-cc07-424c-bbf9-93495e9120db req-ddf175fb-1afe-4e84-a0b1-86e835790f4b service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:27.992569 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-c4bf4d4d-cc07-424c-bbf9-93495e9120db req-ddf175fb-1afe-4e84-a0b1-86e835790f4b service nova] Creating event network-vif-deleted:802d4a9e-0fa0-41e8-876a-385488fc4283 for instance 5a20f292-9867-4b58-a3eb-12f153edd3aa on hv-cinder-81914 Jul 11 14:24:27.997791 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-c4bf4d4d-cc07-424c-bbf9-93495e9120db req-ddf175fb-1afe-4e84-a0b1-86e835790f4b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212703 Jul 11 14:24:27.998983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 502/989] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:24:28.437245 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-57c09180-411f-4f58-9799-b725c647a7a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:28.437980 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-57c09180-411f-4f58-9799-b725c647a7a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:28.444961 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57c09180-411f-4f58-9799-b725c647a7a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:28.445497 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57c09180-411f-4f58-9799-b725c647a7a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:28.446385 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57c09180-411f-4f58-9799-b725c647a7a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:28.446896 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57c09180-411f-4f58-9799-b725c647a7a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:28.461586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-57c09180-411f-4f58-9799-b725c647a7a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] HTTP exception thrown: Instance 5a20f292-9867-4b58-a3eb-12f153edd3aa could not be found. Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-57c09180-411f-4f58-9799-b725c647a7a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Request method failure captured: Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa HTTP/1.1 Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDFQrLza8OpbribeP2OFzZ6bTK5hfozZ39l1B0FblmeUflqdWTwui0ZphovPiopfYGJUpS5F0WQ5oGKN7tyX-KifzCLUyB1dQXUfAHz3__RFnUM9V-2uDDRfnTCtqwk6j9QMt98StEpM_FlR1WUSGqRJwg-pSPAZbwRlKsAiyC_ETdg Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 4463cb0c8f5d473f955e0f08eb7b4e7f Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1900292035 Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:24:28.463336 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:24:28.465526 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:24:28.465526 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1900292035 Jul 11 14:24:28.465526 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 4463cb0c8f5d473f955e0f08eb7b4e7f Jul 11 14:24:28.465526 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1900292035 Jul 11 14:24:28.465526 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeShelveTestJSON-1900292035-project Jul 11 14:24:28.465526 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:24:28.465526 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:24:28.465526 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 999bc8975c43406c838e5c4bb2af1e53 Jul 11 14:24:28.465526 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1900292035-project Jul 11 14:24:28.465526 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:24:28.465526 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance 5a20f292-9867-4b58-a3eb-12f153edd3aa could not be found. Jul 11 14:24:28.465526 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': '5a20f292-9867-4b58-a3eb-12f153edd3aa'} Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a20f292-9867-4b58-a3eb-12f153edd3aa could not be found. Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:24:28.466572 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:24:28.468164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:24:28.468164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:24:28.468164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:24:28.468164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:24:28.468164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:24:28.468164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:24:28.468164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:24:28.468164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a20f292-9867-4b58-a3eb-12f153edd3aa could not be found. Jul 11 14:24:28.468164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:28.468164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:28.468164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:28.468164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:28.468164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:28.468164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:28.468164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:24:28.468164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:24:28.468164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a20f292-9867-4b58-a3eb-12f153edd3aa could not be found. Jul 11 14:24:28.468164 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:28.470644 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-57c09180-411f-4f58-9799-b725c647a7a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Returning 404 to user: Instance 5a20f292-9867-4b58-a3eb-12f153edd3aa could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:24:28.470644 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-57c09180-411f-4f58-9799-b725c647a7a4 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 404 len: 111 microversion: 2.20 time: 0.031731 Jul 11 14:24:28.470644 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 488/990] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:24:28 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 14:24:28.475128 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6aa11dd8-ef58-42dd-b109-1833ca748d51 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '.version_select at 0x7fc976b6a160>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:28.492797 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6aa11dd8-ef58-42dd-b109-1833ca748d51 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964658321" status: 204 len: 0 microversion: 2.20 time: 0.022647 Jul 11 14:24:28.493653 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 503/991] 10.222.0.66 () {60 vars in 1261 bytes} [Mon Jul 11 14:24:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964658321 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 11 14:24:30.291985 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0d99f663-f7ea-424a-b0b5-51de2a47ebfa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:30.292475 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0d99f663-f7ea-424a-b0b5-51de2a47ebfa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:30.299069 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0d99f663-f7ea-424a-b0b5-51de2a47ebfa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:30.299522 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0d99f663-f7ea-424a-b0b5-51de2a47ebfa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:30.300323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0d99f663-f7ea-424a-b0b5-51de2a47ebfa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:30.301369 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0d99f663-f7ea-424a-b0b5-51de2a47ebfa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:30.314780 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-0d99f663-f7ea-424a-b0b5-51de2a47ebfa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] HTTP exception thrown: Instance 5a20f292-9867-4b58-a3eb-12f153edd3aa could not be found. Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0d99f663-f7ea-424a-b0b5-51de2a47ebfa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Request method failure captured: Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa HTTP/1.1 Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDFQrLza8OpbribeP2OFzZ6bTK5hfozZ39l1B0FblmeUflqdWTwui0ZphovPiopfYGJUpS5F0WQ5oGKN7tyX-KifzCLUyB1dQXUfAHz3__RFnUM9V-2uDDRfnTCtqwk6j9QMt98StEpM_FlR1WUSGqRJwg-pSPAZbwRlKsAiyC_ETdg Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 4463cb0c8f5d473f955e0f08eb7b4e7f Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1900292035 Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:24:30.316541 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:24:30.318269 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:24:30.318269 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1900292035 Jul 11 14:24:30.318269 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 4463cb0c8f5d473f955e0f08eb7b4e7f Jul 11 14:24:30.318269 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1900292035 Jul 11 14:24:30.318269 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeShelveTestJSON-1900292035-project Jul 11 14:24:30.318269 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:24:30.318269 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:24:30.318269 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 999bc8975c43406c838e5c4bb2af1e53 Jul 11 14:24:30.318269 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1900292035-project Jul 11 14:24:30.318269 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:24:30.318269 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance 5a20f292-9867-4b58-a3eb-12f153edd3aa could not be found. Jul 11 14:24:30.318269 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': '5a20f292-9867-4b58-a3eb-12f153edd3aa'} Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a20f292-9867-4b58-a3eb-12f153edd3aa could not be found. Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:24:30.319203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a20f292-9867-4b58-a3eb-12f153edd3aa could not be found. Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a20f292-9867-4b58-a3eb-12f153edd3aa could not be found. Jul 11 14:24:30.320700 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:30.322333 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0d99f663-f7ea-424a-b0b5-51de2a47ebfa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Returning 404 to user: Instance 5a20f292-9867-4b58-a3eb-12f153edd3aa could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:24:30.322333 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0d99f663-f7ea-424a-b0b5-51de2a47ebfa tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 404 len: 111 microversion: 2.20 time: 0.030130 Jul 11 14:24:30.322333 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 489/992] 10.222.0.66 () {60 vars in 1279 bytes} [Mon Jul 11 14:24:30 2022] DELETE /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 14:24:30.327118 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-87881754-3da6-493e-9249-b59e57eb41d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:30.327855 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-87881754-3da6-493e-9249-b59e57eb41d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5a20f292-9867-4b58-a3eb-12f153edd3aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:30.334221 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87881754-3da6-493e-9249-b59e57eb41d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:30.334678 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87881754-3da6-493e-9249-b59e57eb41d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:30.335447 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87881754-3da6-493e-9249-b59e57eb41d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:30.335883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87881754-3da6-493e-9249-b59e57eb41d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:30.349965 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-87881754-3da6-493e-9249-b59e57eb41d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] HTTP exception thrown: Instance 5a20f292-9867-4b58-a3eb-12f153edd3aa could not be found. Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-87881754-3da6-493e-9249-b59e57eb41d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Request method failure captured: Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa HTTP/1.1 Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDFQrLza8OpbribeP2OFzZ6bTK5hfozZ39l1B0FblmeUflqdWTwui0ZphovPiopfYGJUpS5F0WQ5oGKN7tyX-KifzCLUyB1dQXUfAHz3__RFnUM9V-2uDDRfnTCtqwk6j9QMt98StEpM_FlR1WUSGqRJwg-pSPAZbwRlKsAiyC_ETdg Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 4463cb0c8f5d473f955e0f08eb7b4e7f Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1900292035 Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:24:30.351641 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:24:30.354289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:24:30.354289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1900292035 Jul 11 14:24:30.354289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 4463cb0c8f5d473f955e0f08eb7b4e7f Jul 11 14:24:30.354289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1900292035 Jul 11 14:24:30.354289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeShelveTestJSON-1900292035-project Jul 11 14:24:30.354289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:24:30.354289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:24:30.354289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 999bc8975c43406c838e5c4bb2af1e53 Jul 11 14:24:30.354289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1900292035-project Jul 11 14:24:30.354289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:24:30.354289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance 5a20f292-9867-4b58-a3eb-12f153edd3aa could not be found. Jul 11 14:24:30.354289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': '5a20f292-9867-4b58-a3eb-12f153edd3aa'} Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a20f292-9867-4b58-a3eb-12f153edd3aa could not be found. Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:24:30.355983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:24:30.358707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:24:30.358707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:24:30.358707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:24:30.358707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:24:30.358707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:24:30.358707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:24:30.358707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:24:30.358707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a20f292-9867-4b58-a3eb-12f153edd3aa could not be found. Jul 11 14:24:30.358707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:30.358707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:30.358707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:30.358707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:30.358707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:30.358707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:30.358707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:24:30.358707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:24:30.358707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a20f292-9867-4b58-a3eb-12f153edd3aa could not be found. Jul 11 14:24:30.358707 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:30.361216 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-87881754-3da6-493e-9249-b59e57eb41d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Returning 404 to user: Instance 5a20f292-9867-4b58-a3eb-12f153edd3aa could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:24:30.361216 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-87881754-3da6-493e-9249-b59e57eb41d7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa" status: 404 len: 111 microversion: 2.20 time: 0.030249 Jul 11 14:24:30.361216 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 504/993] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:24:30 2022] GET /compute/v2.1/servers/5a20f292-9867-4b58-a3eb-12f153edd3aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 11 14:24:31.491610 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e01f1251-ff24-49b2-952a-0c9b2b0238b7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:31.492389 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e01f1251-ff24-49b2-952a-0c9b2b0238b7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:31.498853 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e01f1251-ff24-49b2-952a-0c9b2b0238b7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:31.499335 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e01f1251-ff24-49b2-952a-0c9b2b0238b7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:31.500132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e01f1251-ff24-49b2-952a-0c9b2b0238b7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:31.500571 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e01f1251-ff24-49b2-952a-0c9b2b0238b7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:31.514816 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-e01f1251-ff24-49b2-952a-0c9b2b0238b7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] HTTP exception thrown: Instance 5c32b876-b642-4e8f-b446-3381d1f545f0 could not be found. Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e01f1251-ff24-49b2-952a-0c9b2b0238b7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Request method failure captured: Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 HTTP/1.1 Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDFQrLza8OpbribeP2OFzZ6bTK5hfozZ39l1B0FblmeUflqdWTwui0ZphovPiopfYGJUpS5F0WQ5oGKN7tyX-KifzCLUyB1dQXUfAHz3__RFnUM9V-2uDDRfnTCtqwk6j9QMt98StEpM_FlR1WUSGqRJwg-pSPAZbwRlKsAiyC_ETdg Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 4463cb0c8f5d473f955e0f08eb7b4e7f Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1900292035 Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:24:31.516367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:24:31.518936 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:24:31.518936 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1900292035 Jul 11 14:24:31.518936 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 4463cb0c8f5d473f955e0f08eb7b4e7f Jul 11 14:24:31.518936 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1900292035 Jul 11 14:24:31.518936 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeShelveTestJSON-1900292035-project Jul 11 14:24:31.518936 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:24:31.518936 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:24:31.518936 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 999bc8975c43406c838e5c4bb2af1e53 Jul 11 14:24:31.518936 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1900292035-project Jul 11 14:24:31.518936 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:24:31.518936 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance 5c32b876-b642-4e8f-b446-3381d1f545f0 could not be found. Jul 11 14:24:31.518936 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': '5c32b876-b642-4e8f-b446-3381d1f545f0'} Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c32b876-b642-4e8f-b446-3381d1f545f0 could not be found. Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:24:31.520411 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c32b876-b642-4e8f-b446-3381d1f545f0 could not be found. Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c32b876-b642-4e8f-b446-3381d1f545f0 could not be found. Jul 11 14:24:31.522824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:31.525202 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e01f1251-ff24-49b2-952a-0c9b2b0238b7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Returning 404 to user: Instance 5c32b876-b642-4e8f-b446-3381d1f545f0 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:24:31.525202 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e01f1251-ff24-49b2-952a-0c9b2b0238b7 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 404 len: 111 microversion: 2.20 time: 0.030591 Jul 11 14:24:31.525202 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 490/994] 10.222.0.66 () {60 vars in 1279 bytes} [Mon Jul 11 14:24:31 2022] DELETE /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 14:24:31.527850 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-29655a70-59fa-4ca4-b128-91271ef1e689 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:31.528465 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-29655a70-59fa-4ca4-b128-91271ef1e689 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] [instance: 5c32b876-b642-4e8f-b446-3381d1f545f0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:31.535172 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29655a70-59fa-4ca4-b128-91271ef1e689 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:31.535735 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29655a70-59fa-4ca4-b128-91271ef1e689 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:31.536505 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29655a70-59fa-4ca4-b128-91271ef1e689 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:31.536941 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29655a70-59fa-4ca4-b128-91271ef1e689 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:31.550989 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-29655a70-59fa-4ca4-b128-91271ef1e689 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] HTTP exception thrown: Instance 5c32b876-b642-4e8f-b446-3381d1f545f0 could not be found. Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-29655a70-59fa-4ca4-b128-91271ef1e689 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Request method failure captured: Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 HTTP/1.1 Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDFQrLza8OpbribeP2OFzZ6bTK5hfozZ39l1B0FblmeUflqdWTwui0ZphovPiopfYGJUpS5F0WQ5oGKN7tyX-KifzCLUyB1dQXUfAHz3__RFnUM9V-2uDDRfnTCtqwk6j9QMt98StEpM_FlR1WUSGqRJwg-pSPAZbwRlKsAiyC_ETdg Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 4463cb0c8f5d473f955e0f08eb7b4e7f Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1900292035 Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:24:31.552670 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:24:31.554395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4463cb0c8f5d473f955e0f08eb7b4e7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:24:31.554395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1900292035 Jul 11 14:24:31.554395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 4463cb0c8f5d473f955e0f08eb7b4e7f Jul 11 14:24:31.554395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1900292035 Jul 11 14:24:31.554395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeShelveTestJSON-1900292035-project Jul 11 14:24:31.554395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:24:31.554395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:24:31.554395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 999bc8975c43406c838e5c4bb2af1e53 Jul 11 14:24:31.554395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1900292035-project Jul 11 14:24:31.554395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:24:31.554395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance 5c32b876-b642-4e8f-b446-3381d1f545f0 could not be found. Jul 11 14:24:31.554395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': '5c32b876-b642-4e8f-b446-3381d1f545f0'} Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c32b876-b642-4e8f-b446-3381d1f545f0 could not be found. Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:24:31.555548 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:24:31.557059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:24:31.557059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:24:31.557059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:24:31.557059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:24:31.557059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:24:31.557059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:24:31.557059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:24:31.557059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c32b876-b642-4e8f-b446-3381d1f545f0 could not be found. Jul 11 14:24:31.557059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:31.557059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:31.557059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:31.557059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:31.557059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:31.557059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:31.557059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:24:31.557059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:24:31.557059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c32b876-b642-4e8f-b446-3381d1f545f0 could not be found. Jul 11 14:24:31.557059 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:31.558599 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-29655a70-59fa-4ca4-b128-91271ef1e689 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] Returning 404 to user: Instance 5c32b876-b642-4e8f-b446-3381d1f545f0 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:24:31.558599 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-29655a70-59fa-4ca4-b128-91271ef1e689 tempest-AttachVolumeShelveTestJSON-1900292035 tempest-AttachVolumeShelveTestJSON-1900292035-project] 10.222.0.66 "GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0" status: 404 len: 111 microversion: 2.20 time: 0.030139 Jul 11 14:24:31.558599 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 505/995] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 11 14:24:31 2022] GET /compute/v2.1/servers/5c32b876-b642-4e8f-b446-3381d1f545f0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 14:24:36.087381 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ed9a31bd-7bd3-41d7-b7cc-876ffbb63418 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] Action: 'create', calling method: .version_select at 0x7fc976ca18b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-308242369", "metadata": {"Type": "work"}}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ed9a31bd-7bd3-41d7-b7cc-876ffbb63418 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] Request method failure captured: Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 121 Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDKjyo45pgr_slhYTRkwxAWIRdIihUGVXJoTnBPtYfqpyPq63qdfwKtBwrB4lYfqp3RLnjUdmW5r9Prl6WyjIwiJVbQx4c3y7ZvH8VNkZH8YSWCH9o1jBQNcczb4IbDJjdJz34W6gNSQpN_-JOpoIeSywF8VMM2qiYKPLaCjDFJHkj4 Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: f89040432f8449f6a655a4dce1768c99 Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesNegativeTest-555388874 Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:24:36.109132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:24:36.110903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f89040432f8449f6a655a4dce1768c99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f89040432f8449f6a655a4dce1768c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f89040432f8449f6a655a4dce1768c99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f89040432f8449f6a655a4dce1768c99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:24:36.110903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesNegativeTest-555388874 Jul 11 14:24:36.110903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: f89040432f8449f6a655a4dce1768c99 Jul 11 14:24:36.110903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesNegativeTest-555388874 Jul 11 14:24:36.110903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesNegativeTest-555388874-project Jul 11 14:24:36.110903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:24:36.110903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:24:36.110903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: cc24104a38544c899b7c460b9c96d7ef Jul 11 14:24:36.110903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesNegativeTest-555388874-project Jul 11 14:24:36.110903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Jul 11 14:24:36.110903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-308242369", "metadata": {"Type": "work"}}} Jul 11 14:24:36.110903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: Jul 11 14:24:36.110903 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-308242369', 'metadata': {'Type': 'work'}}}} Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise error Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi '#$%' Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:24:36.113791 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 11 14:24:36.115455 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 11 14:24:36.117046 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 11 14:24:36.117046 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.117046 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ed9a31bd-7bd3-41d7-b7cc-876ffbb63418 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:24:36.117046 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ed9a31bd-7bd3-41d7-b7cc-876ffbb63418 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.135780 Jul 11 14:24:36.117046 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 491/996] 10.222.0.66 () {60 vars in 1155 bytes} [Mon Jul 11 14:24:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 14:24:36.121747 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f7cadd82-d1c3-4d4e-a2c3-630811a8cee9 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] Action: 'create', calling method: .version_select at 0x7fc976b3f8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2031057195", "metadata": {"Type": "work"}}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f7cadd82-d1c3-4d4e-a2c3-630811a8cee9 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] Request method failure captured: Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 120 Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDKjyo45pgr_slhYTRkwxAWIRdIihUGVXJoTnBPtYfqpyPq63qdfwKtBwrB4lYfqp3RLnjUdmW5r9Prl6WyjIwiJVbQx4c3y7ZvH8VNkZH8YSWCH9o1jBQNcczb4IbDJjdJz34W6gNSQpN_-JOpoIeSywF8VMM2qiYKPLaCjDFJHkj4 Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: f89040432f8449f6a655a4dce1768c99 Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-555388874 Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:24:36.124973 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:24:36.126615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f89040432f8449f6a655a4dce1768c99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f89040432f8449f6a655a4dce1768c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f89040432f8449f6a655a4dce1768c99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f89040432f8449f6a655a4dce1768c99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:24:36.126615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-555388874 Jul 11 14:24:36.126615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: f89040432f8449f6a655a4dce1768c99 Jul 11 14:24:36.126615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-555388874 Jul 11 14:24:36.126615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-555388874-project Jul 11 14:24:36.126615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:24:36.126615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:24:36.126615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: cc24104a38544c899b7c460b9c96d7ef Jul 11 14:24:36.126615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-555388874-project Jul 11 14:24:36.126615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Jul 11 14:24:36.126615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2031057195", "metadata": {"Type": "work"}}} Jul 11 14:24:36.126615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: Jul 11 14:24:36.126615 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2031057195', 'metadata': {'Type': 'work'}}}} Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise error Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi '0' Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:24:36.127515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 11 14:24:36.129328 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 11 14:24:36.130580 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 11 14:24:36.130580 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.130580 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f7cadd82-d1c3-4d4e-a2c3-630811a8cee9 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:24:36.130580 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f7cadd82-d1c3-4d4e-a2c3-630811a8cee9 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008523 Jul 11 14:24:36.130580 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 506/997] 10.222.0.66 () {60 vars in 1155 bytes} [Mon Jul 11 14:24:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 14:24:36.135715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0a0a32a3-5864-4570-8007-bf807d774478 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] Action: 'create', calling method: .version_select at 0x7fc976cb4ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-511400314", "metadata": {"Type": "work"}}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0a0a32a3-5864-4570-8007-bf807d774478 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] Request method failure captured: Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 118 Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDKjyo45pgr_slhYTRkwxAWIRdIihUGVXJoTnBPtYfqpyPq63qdfwKtBwrB4lYfqp3RLnjUdmW5r9Prl6WyjIwiJVbQx4c3y7ZvH8VNkZH8YSWCH9o1jBQNcczb4IbDJjdJz34W6gNSQpN_-JOpoIeSywF8VMM2qiYKPLaCjDFJHkj4 Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: f89040432f8449f6a655a4dce1768c99 Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesNegativeTest-555388874 Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:24:36.139213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:24:36.140804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f89040432f8449f6a655a4dce1768c99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f89040432f8449f6a655a4dce1768c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f89040432f8449f6a655a4dce1768c99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f89040432f8449f6a655a4dce1768c99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:24:36.140804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesNegativeTest-555388874 Jul 11 14:24:36.140804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: f89040432f8449f6a655a4dce1768c99 Jul 11 14:24:36.140804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesNegativeTest-555388874 Jul 11 14:24:36.140804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesNegativeTest-555388874-project Jul 11 14:24:36.140804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:24:36.140804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:24:36.140804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: cc24104a38544c899b7c460b9c96d7ef Jul 11 14:24:36.140804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesNegativeTest-555388874-project Jul 11 14:24:36.140804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Jul 11 14:24:36.140804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-511400314", "metadata": {"Type": "work"}}} Jul 11 14:24:36.140804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: Jul 11 14:24:36.140804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-511400314', 'metadata': {'Type': 'work'}}}} Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise error Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi '' Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:24:36.141921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 11 14:24:36.143540 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 11 14:24:36.146010 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 11 14:24:36.146010 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.146010 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0a0a32a3-5864-4570-8007-bf807d774478 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:24:36.146010 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0a0a32a3-5864-4570-8007-bf807d774478 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008544 Jul 11 14:24:36.146010 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 492/998] 10.222.0.66 () {60 vars in 1155 bytes} [Mon Jul 11 14:24:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 14:24:36.150991 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b9c2d0b5-d5a7-41e5-ad3f-28a544e4da34 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] Calling method '.version_select at 0x7fc976ba6160>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:36.185859 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-b9c2d0b5-d5a7-41e5-ad3f-28a544e4da34 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] HTTP exception thrown: Volume tempest-invalid-787884426 could not be found. Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b9c2d0b5-d5a7-41e5-ad3f-28a544e4da34 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] Request method failure captured: Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-787884426 HTTP/1.1 Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDKjyo45pgr_slhYTRkwxAWIRdIihUGVXJoTnBPtYfqpyPq63qdfwKtBwrB4lYfqp3RLnjUdmW5r9Prl6WyjIwiJVbQx4c3y7ZvH8VNkZH8YSWCH9o1jBQNcczb4IbDJjdJz34W6gNSQpN_-JOpoIeSywF8VMM2qiYKPLaCjDFJHkj4 Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: f89040432f8449f6a655a4dce1768c99 Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-555388874 Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:24:36.187865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:24:36.189514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f89040432f8449f6a655a4dce1768c99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f89040432f8449f6a655a4dce1768c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f89040432f8449f6a655a4dce1768c99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f89040432f8449f6a655a4dce1768c99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:24:36.189514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-555388874 Jul 11 14:24:36.189514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: f89040432f8449f6a655a4dce1768c99 Jul 11 14:24:36.189514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-555388874 Jul 11 14:24:36.189514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-555388874-project Jul 11 14:24:36.189514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:24:36.189514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:24:36.189514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: cc24104a38544c899b7c460b9c96d7ef Jul 11 14:24:36.189514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-555388874-project Jul 11 14:24:36.189514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: Jul 11 14:24:36.189514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Volume tempest-invalid-787884426 could not be found. Jul 11 14:24:36.189514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': 'tempest-invalid-787884426'} Jul 11 14:24:36.189514 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-787884426 could not be found. (HTTP 404) (Request-ID: req-5849abb6-b6f9-4bbb-bb1d-93154b096e79) Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:36.190480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 14:24:36.192257 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-787884426 could not be found. Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:24:36.193492 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-787884426 could not be found. Jul 11 14:24:36.194823 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.194823 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:36.194823 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.194823 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.194823 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:36.194823 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:36.194823 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:24:36.194823 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:24:36.194823 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-787884426 could not be found. Jul 11 14:24:36.194823 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.194823 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b9c2d0b5-d5a7-41e5-ad3f-28a544e4da34 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] Returning 404 to user: Volume tempest-invalid-787884426 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:24:36.194823 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b9c2d0b5-d5a7-41e5-ad3f-28a544e4da34 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/tempest-invalid-787884426" status: 404 len: 98 microversion: 2.1 time: 0.042806 Jul 11 14:24:36.194823 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 507/999] 10.222.0.66 () {58 vars in 1214 bytes} [Mon Jul 11 14:24:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-787884426 => generated 98 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 11 14:24:36.204996 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-866768b8-28c5-4cf3-822f-5b80feda5c1b tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003906 Jul 11 14:24:36.205591 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 493/1000] 10.222.0.66 () {58 vars in 1139 bytes} [Mon Jul 11 14:24:36 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 11 14:24:36.215978 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e97e0f85-cb1e-4b4b-ab18-d5620224adb9 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003929 Jul 11 14:24:36.216504 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 508/1001] 10.222.0.66 () {58 vars in 1136 bytes} [Mon Jul 11 14:24:36 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 11 14:24:36.226347 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-110ce768-5367-430f-aabe-8e4d3434f997 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] Calling method '.version_select at 0x7fc976bd6820>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:36.255426 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-110ce768-5367-430f-aabe-8e4d3434f997 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] HTTP exception thrown: Volume 17c00b3a-89c0-48f3-b8e4-d7656c086111 could not be found. Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-110ce768-5367-430f-aabe-8e4d3434f997 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] Request method failure captured: Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/os-volumes/17c00b3a-89c0-48f3-b8e4-d7656c086111 HTTP/1.1 Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDKjyo45pgr_slhYTRkwxAWIRdIihUGVXJoTnBPtYfqpyPq63qdfwKtBwrB4lYfqp3RLnjUdmW5r9Prl6WyjIwiJVbQx4c3y7ZvH8VNkZH8YSWCH9o1jBQNcczb4IbDJjdJz34W6gNSQpN_-JOpoIeSywF8VMM2qiYKPLaCjDFJHkj4 Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: f89040432f8449f6a655a4dce1768c99 Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesNegativeTest-555388874 Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:24:36.258678 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:24:36.260314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f89040432f8449f6a655a4dce1768c99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f89040432f8449f6a655a4dce1768c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f89040432f8449f6a655a4dce1768c99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f89040432f8449f6a655a4dce1768c99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:24:36.260314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesNegativeTest-555388874 Jul 11 14:24:36.260314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: f89040432f8449f6a655a4dce1768c99 Jul 11 14:24:36.260314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesNegativeTest-555388874 Jul 11 14:24:36.260314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesNegativeTest-555388874-project Jul 11 14:24:36.260314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:24:36.260314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:24:36.260314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: cc24104a38544c899b7c460b9c96d7ef Jul 11 14:24:36.260314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesNegativeTest-555388874-project Jul 11 14:24:36.260314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: Jul 11 14:24:36.260314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Volume 17c00b3a-89c0-48f3-b8e4-d7656c086111 could not be found. Jul 11 14:24:36.260314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': '17c00b3a-89c0-48f3-b8e4-d7656c086111'} Jul 11 14:24:36.260314 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 17c00b3a-89c0-48f3-b8e4-d7656c086111 could not be found. (HTTP 404) (Request-ID: req-4189b5eb-d189-4b5a-a3c4-2602d67a25e3) Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:36.261205 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 14:24:36.262441 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 17c00b3a-89c0-48f3-b8e4-d7656c086111 could not be found. Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 11 14:24:36.263621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:24:36.264845 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 17c00b3a-89c0-48f3-b8e4-d7656c086111 could not be found. Jul 11 14:24:36.264845 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.264845 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:36.264845 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.264845 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.264845 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:36.264845 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:36.264845 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:24:36.264845 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:24:36.264845 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 17c00b3a-89c0-48f3-b8e4-d7656c086111 could not be found. Jul 11 14:24:36.264845 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.264845 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-110ce768-5367-430f-aabe-8e4d3434f997 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] Returning 404 to user: Volume 17c00b3a-89c0-48f3-b8e4-d7656c086111 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:24:36.264845 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-110ce768-5367-430f-aabe-8e4d3434f997 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/17c00b3a-89c0-48f3-b8e4-d7656c086111" status: 404 len: 109 microversion: 2.1 time: 0.038301 Jul 11 14:24:36.264845 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 494/1002] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 11 14:24:36 2022] DELETE /compute/v2.1/os-volumes/17c00b3a-89c0-48f3-b8e4-d7656c086111 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:24:36.270451 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-83ff7359-50b8-44a5-81ed-bb5584e2f664 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] Calling method '.version_select at 0x7fc97c033c10>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:36.298088 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-83ff7359-50b8-44a5-81ed-bb5584e2f664 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] HTTP exception thrown: Volume 358b73c5-7738-4256-8876-75f0dd77fab9 could not be found. Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-83ff7359-50b8-44a5-81ed-bb5584e2f664 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] Request method failure captured: Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/os-volumes/358b73c5-7738-4256-8876-75f0dd77fab9 HTTP/1.1 Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDKjyo45pgr_slhYTRkwxAWIRdIihUGVXJoTnBPtYfqpyPq63qdfwKtBwrB4lYfqp3RLnjUdmW5r9Prl6WyjIwiJVbQx4c3y7ZvH8VNkZH8YSWCH9o1jBQNcczb4IbDJjdJz34W6gNSQpN_-JOpoIeSywF8VMM2qiYKPLaCjDFJHkj4 Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: f89040432f8449f6a655a4dce1768c99 Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-555388874 Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:24:36.300133 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:24:36.301883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f89040432f8449f6a655a4dce1768c99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f89040432f8449f6a655a4dce1768c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f89040432f8449f6a655a4dce1768c99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f89040432f8449f6a655a4dce1768c99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:24:36.301883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-555388874 Jul 11 14:24:36.301883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: f89040432f8449f6a655a4dce1768c99 Jul 11 14:24:36.301883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-555388874 Jul 11 14:24:36.301883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-555388874-project Jul 11 14:24:36.301883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:24:36.301883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:24:36.301883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: cc24104a38544c899b7c460b9c96d7ef Jul 11 14:24:36.301883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-555388874-project Jul 11 14:24:36.301883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: Jul 11 14:24:36.301883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Volume 358b73c5-7738-4256-8876-75f0dd77fab9 could not be found. Jul 11 14:24:36.301883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': '358b73c5-7738-4256-8876-75f0dd77fab9'} Jul 11 14:24:36.301883 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 358b73c5-7738-4256-8876-75f0dd77fab9 could not be found. (HTTP 404) (Request-ID: req-0dd68593-b8b3-462f-b08e-b665496128bf) Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:36.302858 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:24:36.304281 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 358b73c5-7738-4256-8876-75f0dd77fab9 could not be found. Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 14:24:36.305845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:24:36.307272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 358b73c5-7738-4256-8876-75f0dd77fab9 could not be found. Jul 11 14:24:36.307272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.307272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:36.307272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.307272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:36.307272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:36.307272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:36.307272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:24:36.307272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:24:36.307272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 358b73c5-7738-4256-8876-75f0dd77fab9 could not be found. Jul 11 14:24:36.307272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:36.307272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-83ff7359-50b8-44a5-81ed-bb5584e2f664 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] Returning 404 to user: Volume 358b73c5-7738-4256-8876-75f0dd77fab9 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:24:36.307272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-83ff7359-50b8-44a5-81ed-bb5584e2f664 tempest-VolumesNegativeTest-555388874 tempest-VolumesNegativeTest-555388874-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/358b73c5-7738-4256-8876-75f0dd77fab9" status: 404 len: 109 microversion: 2.1 time: 0.035620 Jul 11 14:24:36.307272 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 509/1003] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 11 14:24:36 2022] GET /compute/v2.1/os-volumes/358b73c5-7738-4256-8876-75f0dd77fab9 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:24:42.580135 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=12 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:42.580808 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=24 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:42.587317 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-40246fe0-f2a7-4fd1-a1a4-a29a19ade27e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:42.587851 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-40246fe0-f2a7-4fd1-a1a4-a29a19ade27e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:42.594849 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40246fe0-f2a7-4fd1-a1a4-a29a19ade27e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:42.595291 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40246fe0-f2a7-4fd1-a1a4-a29a19ade27e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:42.596052 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40246fe0-f2a7-4fd1-a1a4-a29a19ade27e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:42.596480 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40246fe0-f2a7-4fd1-a1a4-a29a19ade27e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:42.620158 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-40246fe0-f2a7-4fd1-a1a4-a29a19ade27e tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78/ips" status: 200 len: 151 microversion: 2.1 time: 0.041264 Jul 11 14:24:42.620756 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 495/1004] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 11 14:24:42 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:24:44.992673 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:44.993426 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:44.998538 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e1ce1fbb-d8d0-4c4b-86dd-93aa6fe5aabe tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fe08cec-fb30-40bd-bf28-b3de00d4a29d"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:24:44.999590 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e1ce1fbb-d8d0-4c4b-86dd-93aa6fe5aabe tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:45.008107 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1ce1fbb-d8d0-4c4b-86dd-93aa6fe5aabe tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:45.008714 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1ce1fbb-d8d0-4c4b-86dd-93aa6fe5aabe tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:45.009484 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1ce1fbb-d8d0-4c4b-86dd-93aa6fe5aabe tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:45.009920 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1ce1fbb-d8d0-4c4b-86dd-93aa6fe5aabe tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:45.296992 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e1ce1fbb-d8d0-4c4b-86dd-93aa6fe5aabe tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "POST /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305483 Jul 11 14:24:45.297736 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 510/1005] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 11 14:24:44 2022] POST /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:24:52.915434 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4629fd32-036e-4138-b3eb-8fa9974cbda6 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:52.915975 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4629fd32-036e-4138-b3eb-8fa9974cbda6 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:52.917945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:52.918609 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=4 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:52.924138 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4629fd32-036e-4138-b3eb-8fa9974cbda6 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:52.924581 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4629fd32-036e-4138-b3eb-8fa9974cbda6 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:52.925351 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4629fd32-036e-4138-b3eb-8fa9974cbda6 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:52.925785 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4629fd32-036e-4138-b3eb-8fa9974cbda6 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:53.010135 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-4629fd32-036e-4138-b3eb-8fa9974cbda6 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lazy-loading 'services' on Instance uuid a1fe8acf-4baf-4413-b971-4c7f2e757f78 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:24:53.087168 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4629fd32-036e-4138-b3eb-8fa9974cbda6 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78/os-volume_attachments/3fe08cec-fb30-40bd-bf28-b3de00d4a29d" status: 202 len: 0 microversion: 2.1 time: 0.175717 Jul 11 14:24:53.087781 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 496/1006] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 11 14:24:52 2022] DELETE /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78/os-volume_attachments/3fe08cec-fb30-40bd-bf28-b3de00d4a29d => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:24:53.096676 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7e7f4327-1a7e-4c58-89e8-79bf1661a254 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:53.097821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7e7f4327-1a7e-4c58-89e8-79bf1661a254 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:53.105584 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e7f4327-1a7e-4c58-89e8-79bf1661a254 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:53.106131 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e7f4327-1a7e-4c58-89e8-79bf1661a254 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:53.107051 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e7f4327-1a7e-4c58-89e8-79bf1661a254 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:53.107510 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e7f4327-1a7e-4c58-89e8-79bf1661a254 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:53.137570 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7e7f4327-1a7e-4c58-89e8-79bf1661a254 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045178 Jul 11 14:24:53.138146 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 511/1007] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:24:53 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:24:54.150797 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5723790f-15a4-4bf6-9731-8807d6697d2f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:54.151868 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5723790f-15a4-4bf6-9731-8807d6697d2f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:54.158265 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5723790f-15a4-4bf6-9731-8807d6697d2f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:54.158717 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5723790f-15a4-4bf6-9731-8807d6697d2f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:54.159491 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5723790f-15a4-4bf6-9731-8807d6697d2f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:54.159923 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5723790f-15a4-4bf6-9731-8807d6697d2f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:54.193542 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5723790f-15a4-4bf6-9731-8807d6697d2f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047941 Jul 11 14:24:54.194136 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 497/1008] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:24:54 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 14:24:54.261821 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1efc9ae3-e1f2-41e3-9765-861209a5e335 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:54.262354 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1efc9ae3-e1f2-41e3-9765-861209a5e335 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:54.269661 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1efc9ae3-e1f2-41e3-9765-861209a5e335 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:54.270108 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1efc9ae3-e1f2-41e3-9765-861209a5e335 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:54.270939 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1efc9ae3-e1f2-41e3-9765-861209a5e335 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:54.271395 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1efc9ae3-e1f2-41e3-9765-861209a5e335 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:54.299166 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1efc9ae3-e1f2-41e3-9765-861209a5e335 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:24:54.378357 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1efc9ae3-e1f2-41e3-9765-861209a5e335 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78" status: 204 len: 0 microversion: 2.1 time: 0.119982 Jul 11 14:24:54.378879 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 512/1009] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:24:54 2022] DELETE /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:24:54.387360 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f12a13b4-ed4a-4a9c-aeaa-7bd9234ce3cd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:54.387943 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f12a13b4-ed4a-4a9c-aeaa-7bd9234ce3cd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:54.394138 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f12a13b4-ed4a-4a9c-aeaa-7bd9234ce3cd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:54.394644 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f12a13b4-ed4a-4a9c-aeaa-7bd9234ce3cd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:54.395458 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f12a13b4-ed4a-4a9c-aeaa-7bd9234ce3cd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:54.395901 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f12a13b4-ed4a-4a9c-aeaa-7bd9234ce3cd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:54.529242 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f12a13b4-ed4a-4a9c-aeaa-7bd9234ce3cd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:54.536805 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f12a13b4-ed4a-4a9c-aeaa-7bd9234ce3cd tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78" status: 200 len: 1683 microversion: 2.1 time: 0.153408 Jul 11 14:24:54.538034 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 498/1010] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:24:54 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:24:55.555404 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-44c84b5d-b070-42e7-9920-11994c3ab26b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:55.556024 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-44c84b5d-b070-42e7-9920-11994c3ab26b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:55.563993 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-44c84b5d-b070-42e7-9920-11994c3ab26b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:55.564860 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-44c84b5d-b070-42e7-9920-11994c3ab26b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:55.565648 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-44c84b5d-b070-42e7-9920-11994c3ab26b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:55.566082 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-44c84b5d-b070-42e7-9920-11994c3ab26b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:55.700095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-44c84b5d-b070-42e7-9920-11994c3ab26b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:55.707894 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-44c84b5d-b070-42e7-9920-11994c3ab26b tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78" status: 200 len: 1683 microversion: 2.1 time: 0.156841 Jul 11 14:24:55.708473 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 513/1011] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:24:55 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:24:56.730373 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5c025056-b387-47a4-8a2c-5ef9a8d75b90 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:56.730989 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5c025056-b387-47a4-8a2c-5ef9a8d75b90 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:56.737946 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c025056-b387-47a4-8a2c-5ef9a8d75b90 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:56.738430 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c025056-b387-47a4-8a2c-5ef9a8d75b90 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:56.739212 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c025056-b387-47a4-8a2c-5ef9a8d75b90 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:56.739650 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c025056-b387-47a4-8a2c-5ef9a8d75b90 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:56.884564 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5c025056-b387-47a4-8a2c-5ef9a8d75b90 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbea49c1a55481c9995f04f2e9b8618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c5e99c9761441fbad367a0bb8e1e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:56.892018 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5c025056-b387-47a4-8a2c-5ef9a8d75b90 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78" status: 200 len: 1683 microversion: 2.1 time: 0.166128 Jul 11 14:24:56.892610 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 499/1012] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:24:56 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:24:57.167945 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-48ff1cbf-016f-4e51-a5a9-caeaa4842ff4 req-aebff264-4da4-4fa0-9bcd-561d11a30340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1fe8acf-4baf-4413-b971-4c7f2e757f78", "name": "network-vif-deleted", "tag": "d97c6a94-27eb-4401-99b9-8acb19c02474"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:24:57.178325 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-48ff1cbf-016f-4e51-a5a9-caeaa4842ff4 req-aebff264-4da4-4fa0-9bcd-561d11a30340 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:57.180114 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-48ff1cbf-016f-4e51-a5a9-caeaa4842ff4 req-aebff264-4da4-4fa0-9bcd-561d11a30340 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:57.193597 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-48ff1cbf-016f-4e51-a5a9-caeaa4842ff4 req-aebff264-4da4-4fa0-9bcd-561d11a30340 service nova] Creating event network-vif-deleted:d97c6a94-27eb-4401-99b9-8acb19c02474 for instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 on hv-cinder-81914 Jul 11 14:24:57.204165 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-48ff1cbf-016f-4e51-a5a9-caeaa4842ff4 req-aebff264-4da4-4fa0-9bcd-561d11a30340 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040427 Jul 11 14:24:57.205588 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 514/1013] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:24:57.910635 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-11e3bef6-9be2-41fd-a753-701dc8bfceb2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:57.911360 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-11e3bef6-9be2-41fd-a753-701dc8bfceb2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:57.918488 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-11e3bef6-9be2-41fd-a753-701dc8bfceb2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:57.918934 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-11e3bef6-9be2-41fd-a753-701dc8bfceb2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:57.919715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-11e3bef6-9be2-41fd-a753-701dc8bfceb2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:57.920149 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-11e3bef6-9be2-41fd-a753-701dc8bfceb2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:57.934427 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-11e3bef6-9be2-41fd-a753-701dc8bfceb2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] HTTP exception thrown: Instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 could not be found. Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-11e3bef6-9be2-41fd-a753-701dc8bfceb2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Request method failure captured: Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 HTTP/1.1 Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDGazgesZ8gm-xkGX3sogYiEnmE9DbvhKeeh7tJMTX6Y58vVTm48pJ0qqerjCEqeh3Rk7vIu5Mf6TPbuSudm7DddzzEsc9NjqbILyr7XHvKKA7DT_oLLVUIhEbYpW0g3TYtb5AJyNnSid_YkDT-vH95HrvzbM46bM90tJC5hswTE0Jw Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:24:57.936142 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:24:57.937709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:24:57.937709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:24:57.937709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:24:57.937709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:24:57.937709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:24:57.937709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:24:57.937709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:24:57.937709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 5bbea49c1a55481c9995f04f2e9b8618 Jul 11 14:24:57.937709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:24:57.937709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:24:57.937709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 could not be found. Jul 11 14:24:57.937709 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': 'a1fe8acf-4baf-4413-b971-4c7f2e757f78'} Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 could not be found. Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:24:57.939036 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:24:57.940449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:24:57.940449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:24:57.940449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:24:57.940449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:24:57.940449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:24:57.940449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:24:57.940449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:24:57.940449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 could not be found. Jul 11 14:24:57.940449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:57.940449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:57.940449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:57.940449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:57.940449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:57.940449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:57.940449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:24:57.940449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:24:57.940449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 could not be found. Jul 11 14:24:57.940449 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:57.942342 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-11e3bef6-9be2-41fd-a753-701dc8bfceb2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Returning 404 to user: Instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:24:57.942342 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-11e3bef6-9be2-41fd-a753-701dc8bfceb2 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78" status: 404 len: 111 microversion: 2.1 time: 0.030901 Jul 11 14:24:57.942342 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 500/1014] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:24:57 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:24:57.947932 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b3e29cb1-dddf-4f97-937d-a146aa05263f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '.version_select at 0x7fc97752ae50>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:57.966321 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b3e29cb1-dddf-4f97-937d-a146aa05263f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-720695196" status: 202 len: 0 microversion: 2.1 time: 0.022542 Jul 11 14:24:57.966904 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 515/1015] 10.222.0.66 () {58 vars in 1217 bytes} [Mon Jul 11 14:24:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-720695196 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:24:59.777198 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a3ae9a98-8d52-48c6-ab41-1ddca877c24f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:59.777802 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a3ae9a98-8d52-48c6-ab41-1ddca877c24f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:59.784364 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3ae9a98-8d52-48c6-ab41-1ddca877c24f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:59.785041 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3ae9a98-8d52-48c6-ab41-1ddca877c24f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:59.786946 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3ae9a98-8d52-48c6-ab41-1ddca877c24f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:59.786946 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3ae9a98-8d52-48c6-ab41-1ddca877c24f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:59.803213 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-a3ae9a98-8d52-48c6-ab41-1ddca877c24f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] HTTP exception thrown: Instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 could not be found. Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a3ae9a98-8d52-48c6-ab41-1ddca877c24f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Request method failure captured: Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 HTTP/1.1 Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDGazgesZ8gm-xkGX3sogYiEnmE9DbvhKeeh7tJMTX6Y58vVTm48pJ0qqerjCEqeh3Rk7vIu5Mf6TPbuSudm7DddzzEsc9NjqbILyr7XHvKKA7DT_oLLVUIhEbYpW0g3TYtb5AJyNnSid_YkDT-vH95HrvzbM46bM90tJC5hswTE0Jw Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:24:59.807216 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:24:59.808873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:24:59.808873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:24:59.808873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:24:59.808873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:24:59.808873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:24:59.808873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:24:59.808873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:24:59.808873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 5bbea49c1a55481c9995f04f2e9b8618 Jul 11 14:24:59.808873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:24:59.808873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:24:59.808873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 could not be found. Jul 11 14:24:59.808873 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': 'a1fe8acf-4baf-4413-b971-4c7f2e757f78'} Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 could not be found. Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:24:59.809704 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 could not be found. Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 could not be found. Jul 11 14:24:59.811028 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:24:59.812598 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a3ae9a98-8d52-48c6-ab41-1ddca877c24f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Returning 404 to user: Instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:24:59.813733 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a3ae9a98-8d52-48c6-ab41-1ddca877c24f tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78" status: 404 len: 111 microversion: 2.1 time: 0.041508 Jul 11 14:24:59.814779 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 501/1016] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:24:59 2022] DELETE /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:24:59.824807 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9f8bc502-6f92-4a3d-8df4-f9c46fc5a2ed tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:59.825558 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9f8bc502-6f92-4a3d-8df4-f9c46fc5a2ed tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: a1fe8acf-4baf-4413-b971-4c7f2e757f78] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:59.833106 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f8bc502-6f92-4a3d-8df4-f9c46fc5a2ed tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:59.833646 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f8bc502-6f92-4a3d-8df4-f9c46fc5a2ed tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:59.834947 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f8bc502-6f92-4a3d-8df4-f9c46fc5a2ed tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:59.836150 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f8bc502-6f92-4a3d-8df4-f9c46fc5a2ed tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:59.855378 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-9f8bc502-6f92-4a3d-8df4-f9c46fc5a2ed tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] HTTP exception thrown: Instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 could not be found. Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9f8bc502-6f92-4a3d-8df4-f9c46fc5a2ed tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Request method failure captured: Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 HTTP/1.1 Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDGazgesZ8gm-xkGX3sogYiEnmE9DbvhKeeh7tJMTX6Y58vVTm48pJ0qqerjCEqeh3Rk7vIu5Mf6TPbuSudm7DddzzEsc9NjqbILyr7XHvKKA7DT_oLLVUIhEbYpW0g3TYtb5AJyNnSid_YkDT-vH95HrvzbM46bM90tJC5hswTE0Jw Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:24:59.857463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:24:59.858948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:24:59.858948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:24:59.858948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:24:59.858948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:24:59.858948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:24:59.858948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:24:59.858948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:24:59.858948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 5bbea49c1a55481c9995f04f2e9b8618 Jul 11 14:24:59.858948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:24:59.858948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:24:59.858948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 could not be found. Jul 11 14:24:59.858948 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': 'a1fe8acf-4baf-4413-b971-4c7f2e757f78'} Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 could not be found. Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:24:59.859780 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:24:59.861651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:24:59.861651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:24:59.861651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:24:59.861651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:24:59.861651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:24:59.861651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:24:59.861651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:24:59.861651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 could not be found. Jul 11 14:24:59.861651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:59.861651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:59.861651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:59.861651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:59.861651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:59.861651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:59.861651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:24:59.861651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:24:59.861651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 could not be found. Jul 11 14:24:59.861651 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:24:59.862888 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9f8bc502-6f92-4a3d-8df4-f9c46fc5a2ed tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Returning 404 to user: Instance a1fe8acf-4baf-4413-b971-4c7f2e757f78 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:24:59.862888 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9f8bc502-6f92-4a3d-8df4-f9c46fc5a2ed tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78" status: 404 len: 111 microversion: 2.1 time: 0.039840 Jul 11 14:24:59.862888 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 516/1017] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:24:59 2022] GET /compute/v2.1/servers/a1fe8acf-4baf-4413-b971-4c7f2e757f78 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:25:04.172860 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9344bdc9-3b81-4424-94b1-699c7234348a tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:04.173367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9344bdc9-3b81-4424-94b1-699c7234348a tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:25:04.180957 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9344bdc9-3b81-4424-94b1-699c7234348a tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:04.181403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9344bdc9-3b81-4424-94b1-699c7234348a tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:04.182180 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9344bdc9-3b81-4424-94b1-699c7234348a tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:04.182648 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9344bdc9-3b81-4424-94b1-699c7234348a tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:04.196138 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-9344bdc9-3b81-4424-94b1-699c7234348a tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] HTTP exception thrown: Instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 could not be found. Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9344bdc9-3b81-4424-94b1-699c7234348a tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Request method failure captured: Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 HTTP/1.1 Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDGazgesZ8gm-xkGX3sogYiEnmE9DbvhKeeh7tJMTX6Y58vVTm48pJ0qqerjCEqeh3Rk7vIu5Mf6TPbuSudm7DddzzEsc9NjqbILyr7XHvKKA7DT_oLLVUIhEbYpW0g3TYtb5AJyNnSid_YkDT-vH95HrvzbM46bM90tJC5hswTE0Jw Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:25:04.197715 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:25:04.199195 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:25:04.199195 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:25:04.199195 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:25:04.199195 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:25:04.199195 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:25:04.199195 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:25:04.199195 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:25:04.199195 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 5bbea49c1a55481c9995f04f2e9b8618 Jul 11 14:25:04.199195 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:25:04.199195 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:25:04.199195 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 could not be found. Jul 11 14:25:04.199195 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': 'f166a5e8-f81d-4879-aa18-19c8cf86cd44'} Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 could not be found. Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:25:04.200022 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 could not be found. Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 could not be found. Jul 11 14:25:04.201318 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.202649 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9344bdc9-3b81-4424-94b1-699c7234348a tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Returning 404 to user: Instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:25:04.202649 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9344bdc9-3b81-4424-94b1-699c7234348a tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 404 len: 111 microversion: 2.1 time: 0.030166 Jul 11 14:25:04.202649 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 502/1018] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:25:04 2022] DELETE /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:25:04.207630 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ed30ae53-08e4-4a92-b5a7-d47bf3d65b38 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:04.208269 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ed30ae53-08e4-4a92-b5a7-d47bf3d65b38 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: f166a5e8-f81d-4879-aa18-19c8cf86cd44] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:25:04.215628 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed30ae53-08e4-4a92-b5a7-d47bf3d65b38 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:04.216463 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed30ae53-08e4-4a92-b5a7-d47bf3d65b38 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:04.216848 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed30ae53-08e4-4a92-b5a7-d47bf3d65b38 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:04.217280 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed30ae53-08e4-4a92-b5a7-d47bf3d65b38 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:04.232079 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-ed30ae53-08e4-4a92-b5a7-d47bf3d65b38 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] HTTP exception thrown: Instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 could not be found. Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ed30ae53-08e4-4a92-b5a7-d47bf3d65b38 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Request method failure captured: Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 HTTP/1.1 Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDGazgesZ8gm-xkGX3sogYiEnmE9DbvhKeeh7tJMTX6Y58vVTm48pJ0qqerjCEqeh3Rk7vIu5Mf6TPbuSudm7DddzzEsc9NjqbILyr7XHvKKA7DT_oLLVUIhEbYpW0g3TYtb5AJyNnSid_YkDT-vH95HrvzbM46bM90tJC5hswTE0Jw Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:25:04.233614 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:25:04.235283 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:25:04.235283 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:25:04.235283 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:25:04.235283 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:25:04.235283 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:25:04.235283 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:25:04.235283 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:25:04.235283 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 5bbea49c1a55481c9995f04f2e9b8618 Jul 11 14:25:04.235283 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:25:04.235283 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:25:04.235283 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 could not be found. Jul 11 14:25:04.235283 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': 'f166a5e8-f81d-4879-aa18-19c8cf86cd44'} Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 could not be found. Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:25:04.236168 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:25:04.237448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:25:04.237448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:25:04.237448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:25:04.237448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:25:04.237448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:25:04.237448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:25:04.237448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:25:04.237448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 could not be found. Jul 11 14:25:04.237448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.237448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:04.237448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.237448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:04.237448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:04.237448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:04.237448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:25:04.237448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:25:04.237448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 could not be found. Jul 11 14:25:04.237448 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.238610 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ed30ae53-08e4-4a92-b5a7-d47bf3d65b38 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Returning 404 to user: Instance f166a5e8-f81d-4879-aa18-19c8cf86cd44 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:25:04.238610 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ed30ae53-08e4-4a92-b5a7-d47bf3d65b38 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44" status: 404 len: 111 microversion: 2.1 time: 0.031221 Jul 11 14:25:04.238610 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 517/1019] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:25:04 2022] GET /compute/v2.1/servers/f166a5e8-f81d-4879-aa18-19c8cf86cd44 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:25:04.244452 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e0455aee-6054-4fa9-b8e3-7ec6df9e6c4d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:04.244954 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e0455aee-6054-4fa9-b8e3-7ec6df9e6c4d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:25:04.251115 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e0455aee-6054-4fa9-b8e3-7ec6df9e6c4d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:04.251613 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e0455aee-6054-4fa9-b8e3-7ec6df9e6c4d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:04.252377 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e0455aee-6054-4fa9-b8e3-7ec6df9e6c4d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:04.252812 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e0455aee-6054-4fa9-b8e3-7ec6df9e6c4d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:04.266498 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-e0455aee-6054-4fa9-b8e3-7ec6df9e6c4d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] HTTP exception thrown: Instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 could not be found. Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e0455aee-6054-4fa9-b8e3-7ec6df9e6c4d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Request method failure captured: Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 HTTP/1.1 Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDGazgesZ8gm-xkGX3sogYiEnmE9DbvhKeeh7tJMTX6Y58vVTm48pJ0qqerjCEqeh3Rk7vIu5Mf6TPbuSudm7DddzzEsc9NjqbILyr7XHvKKA7DT_oLLVUIhEbYpW0g3TYtb5AJyNnSid_YkDT-vH95HrvzbM46bM90tJC5hswTE0Jw Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:25:04.268053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:25:04.269664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:25:04.269664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:25:04.269664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:25:04.269664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:25:04.269664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:25:04.269664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:25:04.269664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:25:04.269664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 5bbea49c1a55481c9995f04f2e9b8618 Jul 11 14:25:04.269664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:25:04.269664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:25:04.269664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 could not be found. Jul 11 14:25:04.269664 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': '362320ea-1be9-4e52-b970-1ad8ea945ea0'} Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 could not be found. Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:25:04.270691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 could not be found. Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 could not be found. Jul 11 14:25:04.272850 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.274519 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e0455aee-6054-4fa9-b8e3-7ec6df9e6c4d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Returning 404 to user: Instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:25:04.274519 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e0455aee-6054-4fa9-b8e3-7ec6df9e6c4d tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "DELETE /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 404 len: 111 microversion: 2.1 time: 0.029535 Jul 11 14:25:04.274519 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 503/1020] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:25:04 2022] DELETE /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:25:04.278767 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5b1cf88f-aed0-4f24-9a6a-44cf61354711 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:04.279388 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5b1cf88f-aed0-4f24-9a6a-44cf61354711 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: 362320ea-1be9-4e52-b970-1ad8ea945ea0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:25:04.285447 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b1cf88f-aed0-4f24-9a6a-44cf61354711 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:04.285901 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b1cf88f-aed0-4f24-9a6a-44cf61354711 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:04.286695 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b1cf88f-aed0-4f24-9a6a-44cf61354711 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:04.287135 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b1cf88f-aed0-4f24-9a6a-44cf61354711 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:04.302080 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-5b1cf88f-aed0-4f24-9a6a-44cf61354711 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] HTTP exception thrown: Instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 could not be found. Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5b1cf88f-aed0-4f24-9a6a-44cf61354711 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Request method failure captured: Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 HTTP/1.1 Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDGazgesZ8gm-xkGX3sogYiEnmE9DbvhKeeh7tJMTX6Y58vVTm48pJ0qqerjCEqeh3Rk7vIu5Mf6TPbuSudm7DddzzEsc9NjqbILyr7XHvKKA7DT_oLLVUIhEbYpW0g3TYtb5AJyNnSid_YkDT-vH95HrvzbM46bM90tJC5hswTE0Jw Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:25:04.303751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:25:04.305368 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:25:04.305368 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:25:04.305368 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:25:04.305368 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:25:04.305368 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:25:04.305368 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:25:04.305368 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:25:04.305368 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 5bbea49c1a55481c9995f04f2e9b8618 Jul 11 14:25:04.305368 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:25:04.305368 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:25:04.305368 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 could not be found. Jul 11 14:25:04.305368 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': '362320ea-1be9-4e52-b970-1ad8ea945ea0'} Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 could not be found. Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:25:04.306226 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:25:04.307579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:25:04.307579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:25:04.307579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:25:04.307579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:25:04.307579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:25:04.307579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:25:04.307579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:25:04.307579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 could not be found. Jul 11 14:25:04.307579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.307579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:04.307579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.307579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:04.307579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:04.307579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:04.307579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:25:04.307579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:25:04.307579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 could not be found. Jul 11 14:25:04.307579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:04.309004 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5b1cf88f-aed0-4f24-9a6a-44cf61354711 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Returning 404 to user: Instance 362320ea-1be9-4e52-b970-1ad8ea945ea0 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:25:04.309004 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5b1cf88f-aed0-4f24-9a6a-44cf61354711 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0" status: 404 len: 111 microversion: 2.1 time: 0.030355 Jul 11 14:25:04.309004 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 518/1021] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:25:04 2022] GET /compute/v2.1/servers/362320ea-1be9-4e52-b970-1ad8ea945ea0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 14:25:06.501474 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cc3dafc1-7e0f-448b-b0f1-10b8815a8bba tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:06.502045 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cc3dafc1-7e0f-448b-b0f1-10b8815a8bba tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:25:06.508834 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc3dafc1-7e0f-448b-b0f1-10b8815a8bba tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:06.509313 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc3dafc1-7e0f-448b-b0f1-10b8815a8bba tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:06.510091 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc3dafc1-7e0f-448b-b0f1-10b8815a8bba tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:06.510600 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc3dafc1-7e0f-448b-b0f1-10b8815a8bba tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:06.524460 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-cc3dafc1-7e0f-448b-b0f1-10b8815a8bba tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] HTTP exception thrown: Instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e could not be found. Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cc3dafc1-7e0f-448b-b0f1-10b8815a8bba tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Request method failure captured: Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e HTTP/1.1 Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDGazgesZ8gm-xkGX3sogYiEnmE9DbvhKeeh7tJMTX6Y58vVTm48pJ0qqerjCEqeh3Rk7vIu5Mf6TPbuSudm7DddzzEsc9NjqbILyr7XHvKKA7DT_oLLVUIhEbYpW0g3TYtb5AJyNnSid_YkDT-vH95HrvzbM46bM90tJC5hswTE0Jw Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:25:06.526002 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:25:06.527648 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:25:06.527648 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:25:06.527648 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:25:06.527648 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:25:06.527648 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:25:06.527648 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:25:06.527648 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:25:06.527648 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 5bbea49c1a55481c9995f04f2e9b8618 Jul 11 14:25:06.527648 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:25:06.527648 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: > Jul 11 14:25:06.527648 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e could not be found. Jul 11 14:25:06.527648 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': 'de5ec3b0-8851-4d21-a2ec-5a3e5487d73e'} Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e could not be found. Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:25:06.528620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e could not be found. Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e could not be found. Jul 11 14:25:06.529921 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:06.531297 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cc3dafc1-7e0f-448b-b0f1-10b8815a8bba tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Returning 404 to user: Instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:25:06.531297 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cc3dafc1-7e0f-448b-b0f1-10b8815a8bba tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "DELETE /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e" status: 404 len: 111 microversion: 2.1 time: 0.031538 Jul 11 14:25:06.531297 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 504/1022] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:25:06 2022] DELETE /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 14:25:06.536082 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f1fe1629-8252-40b5-8ab6-a1f48767b577 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:06.536704 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f1fe1629-8252-40b5-8ab6-a1f48767b577 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] [instance: de5ec3b0-8851-4d21-a2ec-5a3e5487d73e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:25:06.543488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1fe1629-8252-40b5-8ab6-a1f48767b577 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:06.543935 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1fe1629-8252-40b5-8ab6-a1f48767b577 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:06.544691 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1fe1629-8252-40b5-8ab6-a1f48767b577 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:06.545126 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1fe1629-8252-40b5-8ab6-a1f48767b577 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:06.559208 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-f1fe1629-8252-40b5-8ab6-a1f48767b577 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] HTTP exception thrown: Instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e could not be found. Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f1fe1629-8252-40b5-8ab6-a1f48767b577 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Request method failure captured: Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e HTTP/1.1 Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDGazgesZ8gm-xkGX3sogYiEnmE9DbvhKeeh7tJMTX6Y58vVTm48pJ0qqerjCEqeh3Rk7vIu5Mf6TPbuSudm7DddzzEsc9NjqbILyr7XHvKKA7DT_oLLVUIhEbYpW0g3TYtb5AJyNnSid_YkDT-vH95HrvzbM46bM90tJC5hswTE0Jw Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:25:06.560724 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:25:06.562493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30c5e99c9761441fbad367a0bb8e1e66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:25:06.562493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:25:06.562493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 30c5e99c9761441fbad367a0bb8e1e66 Jul 11 14:25:06.562493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058153082 Jul 11 14:25:06.562493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:25:06.562493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:25:06.562493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:25:06.562493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 5bbea49c1a55481c9995f04f2e9b8618 Jul 11 14:25:06.562493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-2058153082-project Jul 11 14:25:06.562493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:25:06.562493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e could not be found. Jul 11 14:25:06.562493 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': 'de5ec3b0-8851-4d21-a2ec-5a3e5487d73e'} Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e could not be found. Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:25:06.563489 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:25:06.564998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:25:06.564998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:25:06.564998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:25:06.564998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:25:06.564998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:25:06.564998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:25:06.564998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:25:06.564998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e could not be found. Jul 11 14:25:06.564998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:06.564998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:06.564998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:06.564998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:06.564998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:06.564998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:06.564998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:25:06.564998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:25:06.564998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e could not be found. Jul 11 14:25:06.564998 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:06.566446 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f1fe1629-8252-40b5-8ab6-a1f48767b577 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] Returning 404 to user: Instance de5ec3b0-8851-4d21-a2ec-5a3e5487d73e could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:25:06.566446 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f1fe1629-8252-40b5-8ab6-a1f48767b577 tempest-AttachVolumeNegativeTest-2058153082 tempest-AttachVolumeNegativeTest-2058153082-project] 10.222.0.66 "GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e" status: 404 len: 111 microversion: 2.1 time: 0.029973 Jul 11 14:25:06.566446 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 519/1023] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:25:06 2022] GET /compute/v2.1/servers/de5ec3b0-8851-4d21-a2ec-5a3e5487d73e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:25:11.209049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ea862ff3-0af4-4799-953c-a1b1b6aea747 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Action: 'create', calling method: .version_select at 0x7fc976d33310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-882170831"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:25:11.517676 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ea862ff3-0af4-4799-953c-a1b1b6aea747 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.426486 Jul 11 14:25:11.518446 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 505/1024] 10.222.0.66 () {60 vars in 1154 bytes} [Mon Jul 11 14:25:11 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 428 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 11 14:25:11.530704 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e4b57427-2eb6-424a-8807-82c20cb2dfa2 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Calling method '.version_select at 0x7fc976b01700>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:11.583561 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e4b57427-2eb6-424a-8807-82c20cb2dfa2 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/74f5ecce-184d-4791-a1c2-816829501b18" status: 200 len: 344 microversion: 2.1 time: 0.057308 Jul 11 14:25:11.584312 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 520/1025] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 11 14:25:11 2022] GET /compute/v2.1/os-volumes/74f5ecce-184d-4791-a1c2-816829501b18 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:25:12.597327 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f20e9baa-1c4a-478e-9e02-340ff5f54e15 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Calling method '.version_select at 0x7fc976cf6f70>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:12.645699 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f20e9baa-1c4a-478e-9e02-340ff5f54e15 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/74f5ecce-184d-4791-a1c2-816829501b18" status: 200 len: 345 microversion: 2.1 time: 0.052809 Jul 11 14:25:12.646324 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 506/1026] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 11 14:25:12 2022] GET /compute/v2.1/os-volumes/74f5ecce-184d-4791-a1c2-816829501b18 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:25:12.658439 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-11f5b52d-7b85-4286-9c1d-d1e1e6b0704f tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Action: 'create', calling method: .version_select at 0x7fc976bd6ca0>, body: {"snapshot": {"volume_id": "74f5ecce-184d-4791-a1c2-816829501b18", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-206435533"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:25:12.821880 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-11f5b52d-7b85-4286-9c1d-d1e1e6b0704f tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.167677 Jul 11 14:25:12.822665 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 521/1027] 10.222.0.66 () {60 vars in 1161 bytes} [Mon Jul 11 14:25:12 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:25:12.832291 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-16952cb5-47ed-47e8-ac14-f67d7916d2d6 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Calling method '.version_select at 0x7fc976d33160>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:12.867020 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-16952cb5-47ed-47e8-ac14-f67d7916d2d6 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187" status: 200 len: 286 microversion: 2.1 time: 0.038087 Jul 11 14:25:12.867775 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 507/1028] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Jul 11 14:25:12 2022] GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:25:12.879820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-89cb0a69-78da-4075-8f31-f0afbff87dd1 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Calling method '.version_select at 0x7fc97752adc0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:12.911771 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-89cb0a69-78da-4075-8f31-f0afbff87dd1 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037172 Jul 11 14:25:12.912388 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 522/1029] 10.222.0.66 () {58 vars in 1139 bytes} [Mon Jul 11 14:25:12 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:25:12.923998 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-276ab340-4adf-4f61-b70a-6cbf84984314 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Calling method '.version_select at 0x7fc976d33940>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:12.956967 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-276ab340-4adf-4f61-b70a-6cbf84984314 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187" status: 200 len: 286 microversion: 2.1 time: 0.037388 Jul 11 14:25:12.957703 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 508/1030] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Jul 11 14:25:12 2022] GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:25:13.969662 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4b3b1f6c-40fa-4633-bc83-9e9e7e8f8347 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Calling method '.version_select at 0x7fc97c033670>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:13.999406 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4b3b1f6c-40fa-4633-bc83-9e9e7e8f8347 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187" status: 200 len: 286 microversion: 2.1 time: 0.033965 Jul 11 14:25:13.999989 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 523/1031] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Jul 11 14:25:13 2022] GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:25:15.012290 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e5f92966-339b-44fb-9357-200e5694a67d tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Calling method '.version_select at 0x7fc976ca15e0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:15.042516 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e5f92966-339b-44fb-9357-200e5694a67d tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187" status: 200 len: 286 microversion: 2.1 time: 0.035137 Jul 11 14:25:15.043085 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 509/1032] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Jul 11 14:25:15 2022] GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:25:16.055894 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a4081bfd-5702-41f3-acd0-d7e4d76dd457 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Calling method '.version_select at 0x7fc976a97ee0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:16.091016 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a4081bfd-5702-41f3-acd0-d7e4d76dd457 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187" status: 200 len: 287 microversion: 2.1 time: 0.040361 Jul 11 14:25:16.091640 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 524/1033] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Jul 11 14:25:16 2022] GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:25:16.102915 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-326c8955-0151-45c4-af5f-a72cc9fc8cbf tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Calling method '.version_select at 0x7fc976ce0ca0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:16.160196 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-326c8955-0151-45c4-af5f-a72cc9fc8cbf tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "DELETE /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187" status: 202 len: 0 microversion: 2.1 time: 0.062094 Jul 11 14:25:16.160801 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 510/1034] 10.222.0.66 () {58 vars in 1253 bytes} [Mon Jul 11 14:25:16 2022] DELETE /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:25:16.169414 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f7d9b3e2-b839-4771-8043-8cdf263191e7 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Calling method '.version_select at 0x7fc976c088b0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:16.203264 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f7d9b3e2-b839-4771-8043-8cdf263191e7 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187" status: 200 len: 286 microversion: 2.1 time: 0.037569 Jul 11 14:25:16.203845 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 525/1035] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Jul 11 14:25:16 2022] GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:25:17.212556 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=18 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:17.213824 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:17.218625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d3eaf11d-ebb5-4161-93e6-891148413ffe tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Calling method '.version_select at 0x7fc976cee310>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:17.252367 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d3eaf11d-ebb5-4161-93e6-891148413ffe tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187" status: 200 len: 286 microversion: 2.1 time: 0.040532 Jul 11 14:25:17.252940 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 511/1036] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Jul 11 14:25:17 2022] GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:25:18.261321 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:18.262083 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:18.266524 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3886a3db-3a0e-434b-b0fa-27b37c50e4e7 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Calling method '.version_select at 0x7fc976b01700>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:18.297400 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3886a3db-3a0e-434b-b0fa-27b37c50e4e7 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187" status: 200 len: 286 microversion: 2.1 time: 0.036802 Jul 11 14:25:18.297983 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 526/1037] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Jul 11 14:25:18 2022] GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:25:19.309419 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-df0eeaee-0054-4241-a8f8-047613930c44 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Calling method '.version_select at 0x7fc976d339d0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:19.334919 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-df0eeaee-0054-4241-a8f8-047613930c44 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] HTTP exception thrown: Snapshot 0e0e6404-0b99-4d37-a723-59a1c210e187 could not be found. Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-df0eeaee-0054-4241-a8f8-047613930c44 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Request method failure captured: Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187 HTTP/1.1 Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDLHkKfhpot_kqGHQ37XfQhFaUuQIq69BLhmvNono4oXwyUankNRAMZxDKDUPRzyWP39XVxIymtmBBR4AIQxucvZsOobEiKyXpyBijLQfuZtG92budssGhuh3mBsbVVIyFWiUF2W3ceZj1jDlCf_B0RhVOzYRP_pwD28EEQ3xbnUsYg Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 854f8f12c63f4566b07861c627398ffd Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2078854771 Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:25:19.337837 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:25:19.339625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_854f8f12c63f4566b07861c627398ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/854f8f12c63f4566b07861c627398ffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/854f8f12c63f4566b07861c627398ffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/854f8f12c63f4566b07861c627398ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:25:19.339625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2078854771 Jul 11 14:25:19.339625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 854f8f12c63f4566b07861c627398ffd Jul 11 14:25:19.339625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2078854771 Jul 11 14:25:19.339625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesSnapshotsTestJSON-2078854771-project Jul 11 14:25:19.339625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:25:19.339625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:25:19.339625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 19469ae93b144e9c93eea412e432cd91 Jul 11 14:25:19.339625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2078854771-project Jul 11 14:25:19.339625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: Jul 11 14:25:19.339625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Snapshot 0e0e6404-0b99-4d37-a723-59a1c210e187 could not be found. Jul 11 14:25:19.339625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': '0e0e6404-0b99-4d37-a723-59a1c210e187'} Jul 11 14:25:19.339625 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:25:19.340727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:19.340727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 11 14:25:19.340727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 11 14:25:19.340727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 11 14:25:19.340727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 11 14:25:19.340727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 11 14:25:19.340727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 11 14:25:19.340727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:25:19.340727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:25:19.340727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:25:19.340727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:25:19.340727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:25:19.340727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:25:19.340727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:25:19.340727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:25:19.340727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0e0e6404-0b99-4d37-a723-59a1c210e187 could not be found. (HTTP 404) (Request-ID: req-52379bb4-c8a3-401a-a103-0444f5d93cb9) Jul 11 14:25:19.340727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:19.340727 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:25:19.342204 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0e0e6404-0b99-4d37-a723-59a1c210e187 could not be found. Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 11 14:25:19.345910 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:25:19.347469 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0e0e6404-0b99-4d37-a723-59a1c210e187 could not be found. Jul 11 14:25:19.347469 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:19.347469 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:19.347469 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:19.347469 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:19.347469 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:19.347469 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:19.347469 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:25:19.347469 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:25:19.347469 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0e0e6404-0b99-4d37-a723-59a1c210e187 could not be found. Jul 11 14:25:19.347469 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:19.347469 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-df0eeaee-0054-4241-a8f8-047613930c44 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Returning 404 to user: Snapshot 0e0e6404-0b99-4d37-a723-59a1c210e187 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:25:19.347469 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-df0eeaee-0054-4241-a8f8-047613930c44 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187" status: 404 len: 111 microversion: 2.1 time: 0.034407 Jul 11 14:25:19.348510 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 512/1038] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Jul 11 14:25:19 2022] GET /compute/v2.1/os-snapshots/0e0e6404-0b99-4d37-a723-59a1c210e187 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:25:19.348723 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-724d6526-88ba-4be5-aedc-bb1f5db08c30 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Calling method '.version_select at 0x7fc97751ea60>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:19.417597 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-724d6526-88ba-4be5-aedc-bb1f5db08c30 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/74f5ecce-184d-4791-a1c2-816829501b18" status: 202 len: 0 microversion: 2.1 time: 0.073312 Jul 11 14:25:19.418249 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 527/1039] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 11 14:25:19 2022] DELETE /compute/v2.1/os-volumes/74f5ecce-184d-4791-a1c2-816829501b18 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:25:19.427665 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b3d7c6ae-adde-4606-a2b7-4a2158cd11f9 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Calling method '.version_select at 0x7fc976c069d0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:19.486288 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b3d7c6ae-adde-4606-a2b7-4a2158cd11f9 tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/74f5ecce-184d-4791-a1c2-816829501b18" status: 200 len: 344 microversion: 2.1 time: 0.062705 Jul 11 14:25:19.486861 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 513/1040] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 11 14:25:19 2022] GET /compute/v2.1/os-volumes/74f5ecce-184d-4791-a1c2-816829501b18 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:25:20.499590 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-71c8b728-31bf-4274-9f5b-3f3eac34b80c tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Calling method '.version_select at 0x7fc976bd6af0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:20.530611 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-71c8b728-31bf-4274-9f5b-3f3eac34b80c tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] HTTP exception thrown: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-71c8b728-31bf-4274-9f5b-3f3eac34b80c tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Request method failure captured: Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/os-volumes/74f5ecce-184d-4791-a1c2-816829501b18 HTTP/1.1 Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDLHkKfhpot_kqGHQ37XfQhFaUuQIq69BLhmvNono4oXwyUankNRAMZxDKDUPRzyWP39XVxIymtmBBR4AIQxucvZsOobEiKyXpyBijLQfuZtG92budssGhuh3mBsbVVIyFWiUF2W3ceZj1jDlCf_B0RhVOzYRP_pwD28EEQ3xbnUsYg Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 854f8f12c63f4566b07861c627398ffd Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2078854771 Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:25:20.530944 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:25:20.532515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_854f8f12c63f4566b07861c627398ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/854f8f12c63f4566b07861c627398ffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/854f8f12c63f4566b07861c627398ffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/854f8f12c63f4566b07861c627398ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:25:20.532515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2078854771 Jul 11 14:25:20.532515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 854f8f12c63f4566b07861c627398ffd Jul 11 14:25:20.532515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2078854771 Jul 11 14:25:20.532515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesSnapshotsTestJSON-2078854771-project Jul 11 14:25:20.532515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:25:20.532515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:25:20.532515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 19469ae93b144e9c93eea412e432cd91 Jul 11 14:25:20.532515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2078854771-project Jul 11 14:25:20.532515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: Jul 11 14:25:20.532515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. Jul 11 14:25:20.532515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': '74f5ecce-184d-4791-a1c2-816829501b18'} Jul 11 14:25:20.532515 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. (HTTP 404) (Request-ID: req-86cf18a0-8bda-44a8-a52f-6c22faef433a) Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:20.533688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:25:20.535054 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 14:25:20.536371 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:25:20.537985 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. Jul 11 14:25:20.537985 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.537985 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:20.537985 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.537985 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:20.537985 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:20.537985 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:20.537985 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:25:20.537985 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:25:20.537985 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. Jul 11 14:25:20.537985 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.537985 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-71c8b728-31bf-4274-9f5b-3f3eac34b80c tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Returning 404 to user: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:25:20.537985 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-71c8b728-31bf-4274-9f5b-3f3eac34b80c tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/74f5ecce-184d-4791-a1c2-816829501b18" status: 404 len: 109 microversion: 2.1 time: 0.037075 Jul 11 14:25:20.537985 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 528/1041] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 11 14:25:20 2022] GET /compute/v2.1/os-volumes/74f5ecce-184d-4791-a1c2-816829501b18 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 14:25:20.547950 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4f2e9a9f-3801-4691-8221-5bc23f1fc77c tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Calling method '.version_select at 0x7fc976ca1af0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:20.575892 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-4f2e9a9f-3801-4691-8221-5bc23f1fc77c tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] HTTP exception thrown: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4f2e9a9f-3801-4691-8221-5bc23f1fc77c tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Request method failure captured: Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/os-volumes/74f5ecce-184d-4791-a1c2-816829501b18 HTTP/1.1 Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept: application/json Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Connection: close Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Host: 10.222.0.66 Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABizDLHkKfhpot_kqGHQ37XfQhFaUuQIq69BLhmvNono4oXwyUankNRAMZxDKDUPRzyWP39XVxIymtmBBR4AIQxucvZsOobEiKyXpyBijLQfuZtG92budssGhuh3mBsbVVIyFWiUF2W3ceZj1jDlCf_B0RhVOzYRP_pwD28EEQ3xbnUsYg Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Id: 854f8f12c63f4566b07861c627398ffd Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2078854771 Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jul 11 14:25:20.577825 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jul 11 14:25:20.579804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_854f8f12c63f4566b07861c627398ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/854f8f12c63f4566b07861c627398ffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/854f8f12c63f4566b07861c627398ffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/854f8f12c63f4566b07861c627398ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:25:20.579804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2078854771 Jul 11 14:25:20.579804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 854f8f12c63f4566b07861c627398ffd Jul 11 14:25:20.579804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2078854771 Jul 11 14:25:20.579804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesSnapshotsTestJSON-2078854771-project Jul 11 14:25:20.579804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jul 11 14:25:20.579804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jul 11 14:25:20.579804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Id: 19469ae93b144e9c93eea412e432cd91 Jul 11 14:25:20.579804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2078854771-project Jul 11 14:25:20.579804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: method: Jul 11 14:25:20.579804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: exception: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. Jul 11 14:25:20.579804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: action_args: {'id': '74f5ecce-184d-4791-a1c2-816829501b18'} Jul 11 14:25:20.579804 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. (HTTP 404) (Request-ID: req-dc40c42a-7f59-4502-adea-1bb4af114102) Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:20.581053 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 14:25:20.582400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 11 14:25:20.585792 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:25:20.587274 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. Jul 11 14:25:20.587274 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.587274 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:20.587274 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.587274 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:20.587274 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:20.587274 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:20.587274 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:25:20.587274 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:25:20.587274 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. Jul 11 14:25:20.587274 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.587274 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4f2e9a9f-3801-4691-8221-5bc23f1fc77c tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Returning 404 to user: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:25:20.587274 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4f2e9a9f-3801-4691-8221-5bc23f1fc77c tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/74f5ecce-184d-4791-a1c2-816829501b18" status: 404 len: 109 microversion: 2.1 time: 0.035571 Jul 11 14:25:20.588348 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 514/1042] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 11 14:25:20 2022] DELETE /compute/v2.1/os-volumes/74f5ecce-184d-4791-a1c2-816829501b18 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:25:20.588775 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-89d7d630-8c00-403c-a2c7-ed7097d1aa5a tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Calling method '.version_select at 0x7fc976c08550>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:20.621216 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-89d7d630-8c00-403c-a2c7-ed7097d1aa5a tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] HTTP exception thrown: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-89d7d630-8c00-403c-a2c7-ed7097d1aa5a tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Request method failure captured: Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/os-volumes/74f5ecce-184d-4791-a1c2-816829501b18 HTTP/1.1 Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDLHkKfhpot_kqGHQ37XfQhFaUuQIq69BLhmvNono4oXwyUankNRAMZxDKDUPRzyWP39XVxIymtmBBR4AIQxucvZsOobEiKyXpyBijLQfuZtG92budssGhuh3mBsbVVIyFWiUF2W3ceZj1jDlCf_B0RhVOzYRP_pwD28EEQ3xbnUsYg Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 854f8f12c63f4566b07861c627398ffd Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2078854771 Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:25:20.623177 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:25:20.624616 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_854f8f12c63f4566b07861c627398ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/854f8f12c63f4566b07861c627398ffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/854f8f12c63f4566b07861c627398ffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/854f8f12c63f4566b07861c627398ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:25:20.624616 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2078854771 Jul 11 14:25:20.624616 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 854f8f12c63f4566b07861c627398ffd Jul 11 14:25:20.624616 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2078854771 Jul 11 14:25:20.624616 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesSnapshotsTestJSON-2078854771-project Jul 11 14:25:20.624616 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:25:20.624616 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:25:20.624616 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 19469ae93b144e9c93eea412e432cd91 Jul 11 14:25:20.624616 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2078854771-project Jul 11 14:25:20.624616 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: Jul 11 14:25:20.624616 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. Jul 11 14:25:20.624616 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': '74f5ecce-184d-4791-a1c2-816829501b18'} Jul 11 14:25:20.624616 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. (HTTP 404) (Request-ID: req-8aaa17f8-02b3-4012-93bd-6c4dca7e44a0) Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:20.625488 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:25:20.626884 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 14:25:20.628889 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:25:20.631217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. Jul 11 14:25:20.631217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.631217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:25:20.631217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.631217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:25:20.631217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:25:20.631217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:25:20.631217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:25:20.631217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:25:20.631217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. Jul 11 14:25:20.631217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:25:20.631217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-89d7d630-8c00-403c-a2c7-ed7097d1aa5a tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] Returning 404 to user: Volume 74f5ecce-184d-4791-a1c2-816829501b18 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:25:20.631217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-89d7d630-8c00-403c-a2c7-ed7097d1aa5a tempest-VolumesSnapshotsTestJSON-2078854771 tempest-VolumesSnapshotsTestJSON-2078854771-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/74f5ecce-184d-4791-a1c2-816829501b18" status: 404 len: 109 microversion: 2.1 time: 0.040566 Jul 11 14:25:20.631217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 529/1043] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 11 14:25:20 2022] GET /compute/v2.1/os-volumes/74f5ecce-184d-4791-a1c2-816829501b18 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:25:52.488160 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-60ca1cff-94e1-4363-bd8e-4e3eb91945aa tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Action: 'create', calling method: .version_select at 0x7fc976bf3790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1652678082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHB53ZC6wS7Gq2auAlczUPsrvvNZsCaNwp5VcpySDC6RyPA/9OY2ITfIO7f4JiHY5GJ82Wo5oMjHg5gLMnx84jWhq+xQwIb5bPlP+QQ0imYhmTBGvpanIO4J1f8s8RmpAQ=="}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:25:52.503119 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-60ca1cff-94e1-4363-bd8e-4e3eb91945aa tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Getting quotas for project 47332445bab940c495cb7c4568c5c315. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:25:52.507773 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-60ca1cff-94e1-4363-bd8e-4e3eb91945aa tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Getting quotas for user 8423598c60644919af82bd0280c0c734 and project 47332445bab940c495cb7c4568c5c315. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:25:52.528815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-60ca1cff-94e1-4363-bd8e-4e3eb91945aa tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.046832 Jul 11 14:25:52.529421 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 515/1044] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 11 14:25:52 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:25:52.629772 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c7acab73-caba-4623-9c6a-3158a657dae8 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-858517697", "imageRef": "542f74cb-7543-46eb-ae5d-c46cc07377c4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1652678082", "networks": [{"uuid": "3b6bf096-f5dc-4541-8eb3-5b969b485bfe"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:25:52.680792 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-c7acab73-caba-4623-9c6a-3158a657dae8 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] validate_networks() for [('3b6bf096-f5dc-4541-8eb3-5b969b485bfe', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:25:53.410018 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c7acab73-caba-4623-9c6a-3158a657dae8 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:25:53.410472 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c7acab73-caba-4623-9c6a-3158a657dae8 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:25:53.410943 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c7acab73-caba-4623-9c6a-3158a657dae8 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:25:53.411469 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c7acab73-caba-4623-9c6a-3158a657dae8 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:25:53.412098 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c7acab73-caba-4623-9c6a-3158a657dae8 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:25:53.420964 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7acab73-caba-4623-9c6a-3158a657dae8 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:53.421404 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7acab73-caba-4623-9c6a-3158a657dae8 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:53.422227 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7acab73-caba-4623-9c6a-3158a657dae8 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:53.422660 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7acab73-caba-4623-9c6a-3158a657dae8 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:53.439402 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-c7acab73-caba-4623-9c6a-3158a657dae8 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Getting quotas for project 47332445bab940c495cb7c4568c5c315. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:25:53.444120 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-c7acab73-caba-4623-9c6a-3158a657dae8 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Getting quotas for user 8423598c60644919af82bd0280c0c734 and project 47332445bab940c495cb7c4568c5c315. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:25:53.454790 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c7acab73-caba-4623-9c6a-3158a657dae8 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:25:53.456939 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c7acab73-caba-4623-9c6a-3158a657dae8 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='542f74cb-7543-46eb-ae5d-c46cc07377c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:25:53.502694 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c7acab73-caba-4623-9c6a-3158a657dae8 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877875 Jul 11 14:25:53.503335 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 530/1045] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 11 14:25:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:25:53.515870 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-79865421-44d0-4ed7-9d22-6ca77b28c998 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:53.516508 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-79865421-44d0-4ed7-9d22-6ca77b28c998 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:25:53.574889 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-79865421-44d0-4ed7-9d22-6ca77b28c998 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:25:53.581876 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-79865421-44d0-4ed7-9d22-6ca77b28c998 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1258 microversion: 2.1 time: 0.070966 Jul 11 14:25:53.582487 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 516/1046] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:25:53 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:54.601741 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eb1153a2-4ea6-47d9-a373-df1400e6f297 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:54.602358 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eb1153a2-4ea6-47d9-a373-df1400e6f297 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:25:54.617813 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb1153a2-4ea6-47d9-a373-df1400e6f297 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:54.618279 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb1153a2-4ea6-47d9-a373-df1400e6f297 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:54.619445 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb1153a2-4ea6-47d9-a373-df1400e6f297 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:54.619880 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb1153a2-4ea6-47d9-a373-df1400e6f297 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:54.716173 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eb1153a2-4ea6-47d9-a373-df1400e6f297 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:25:54.725770 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eb1153a2-4ea6-47d9-a373-df1400e6f297 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1318 microversion: 2.1 time: 0.129184 Jul 11 14:25:54.726248 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 531/1047] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:25:54 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1318 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:55.743992 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8eeb6ff8-7426-4309-978b-847efd399b7b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:55.744691 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8eeb6ff8-7426-4309-978b-847efd399b7b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:25:55.760763 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8eeb6ff8-7426-4309-978b-847efd399b7b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:55.761226 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8eeb6ff8-7426-4309-978b-847efd399b7b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:55.762020 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8eeb6ff8-7426-4309-978b-847efd399b7b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:55.762492 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8eeb6ff8-7426-4309-978b-847efd399b7b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:56.059746 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8eeb6ff8-7426-4309-978b-847efd399b7b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:25:56.073000 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8eeb6ff8-7426-4309-978b-847efd399b7b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1358 microversion: 2.1 time: 0.333279 Jul 11 14:25:56.078521 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 517/1048] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:25:55 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1358 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:57.102502 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8a838c3c-5cd5-4332-8fe1-139d7c93f2d3 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:57.103125 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8a838c3c-5cd5-4332-8fe1-139d7c93f2d3 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:25:57.113290 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a838c3c-5cd5-4332-8fe1-139d7c93f2d3 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:57.113993 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a838c3c-5cd5-4332-8fe1-139d7c93f2d3 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:57.116128 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a838c3c-5cd5-4332-8fe1-139d7c93f2d3 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:57.116880 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a838c3c-5cd5-4332-8fe1-139d7c93f2d3 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:57.293052 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8a838c3c-5cd5-4332-8fe1-139d7c93f2d3 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:25:57.300872 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8a838c3c-5cd5-4332-8fe1-139d7c93f2d3 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1358 microversion: 2.1 time: 0.208856 Jul 11 14:25:57.311056 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 532/1049] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:25:57 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:58.319012 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7bbfd8a8-4d7a-4e6a-a8ee-fe84d1e53de2 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:58.319660 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7bbfd8a8-4d7a-4e6a-a8ee-fe84d1e53de2 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:25:58.326621 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7bbfd8a8-4d7a-4e6a-a8ee-fe84d1e53de2 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:58.327074 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7bbfd8a8-4d7a-4e6a-a8ee-fe84d1e53de2 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:58.328015 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7bbfd8a8-4d7a-4e6a-a8ee-fe84d1e53de2 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:58.328943 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7bbfd8a8-4d7a-4e6a-a8ee-fe84d1e53de2 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:58.476448 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7bbfd8a8-4d7a-4e6a-a8ee-fe84d1e53de2 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:25:58.485060 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7bbfd8a8-4d7a-4e6a-a8ee-fe84d1e53de2 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1358 microversion: 2.1 time: 0.170366 Jul 11 14:25:58.486054 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 518/1050] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:25:58 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:59.503217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-83f2f09c-840f-4034-98ab-e9256f5023b0 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:25:59.504866 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-83f2f09c-840f-4034-98ab-e9256f5023b0 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:25:59.511482 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83f2f09c-840f-4034-98ab-e9256f5023b0 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:59.511929 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83f2f09c-840f-4034-98ab-e9256f5023b0 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:59.512904 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83f2f09c-840f-4034-98ab-e9256f5023b0 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:25:59.513487 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83f2f09c-840f-4034-98ab-e9256f5023b0 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:25:59.669301 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-83f2f09c-840f-4034-98ab-e9256f5023b0 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:25:59.676995 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-83f2f09c-840f-4034-98ab-e9256f5023b0 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1358 microversion: 2.1 time: 0.177718 Jul 11 14:25:59.677668 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 533/1051] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:25:59 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:26:00.699334 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-61a73bf7-c708-45bb-bcdf-6e8c1edd0bd3 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:00.701742 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-61a73bf7-c708-45bb-bcdf-6e8c1edd0bd3 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:00.715946 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-61a73bf7-c708-45bb-bcdf-6e8c1edd0bd3 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:00.716945 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-61a73bf7-c708-45bb-bcdf-6e8c1edd0bd3 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:00.718684 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-61a73bf7-c708-45bb-bcdf-6e8c1edd0bd3 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:00.719711 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-61a73bf7-c708-45bb-bcdf-6e8c1edd0bd3 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:00.919241 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-61a73bf7-c708-45bb-bcdf-6e8c1edd0bd3 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:00.929725 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-61a73bf7-c708-45bb-bcdf-6e8c1edd0bd3 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1358 microversion: 2.1 time: 0.238204 Jul 11 14:26:00.931168 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 519/1052] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:00 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:01.949464 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eaed9581-5bbf-4608-bb52-9ac49d0a7028 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:01.950306 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eaed9581-5bbf-4608-bb52-9ac49d0a7028 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:01.959444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eaed9581-5bbf-4608-bb52-9ac49d0a7028 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:01.960351 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eaed9581-5bbf-4608-bb52-9ac49d0a7028 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:01.961550 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eaed9581-5bbf-4608-bb52-9ac49d0a7028 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:01.962041 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eaed9581-5bbf-4608-bb52-9ac49d0a7028 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:02.151187 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eaed9581-5bbf-4608-bb52-9ac49d0a7028 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:02.168556 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eaed9581-5bbf-4608-bb52-9ac49d0a7028 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1358 microversion: 2.1 time: 0.223142 Jul 11 14:26:02.188554 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 534/1053] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:01 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:03.195519 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-36dce513-e84b-4b38-8808-e7adceed2b36 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:03.196131 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-36dce513-e84b-4b38-8808-e7adceed2b36 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:03.204242 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-36dce513-e84b-4b38-8808-e7adceed2b36 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:03.204681 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-36dce513-e84b-4b38-8808-e7adceed2b36 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:03.205461 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-36dce513-e84b-4b38-8808-e7adceed2b36 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:03.205897 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-36dce513-e84b-4b38-8808-e7adceed2b36 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:03.340420 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-36dce513-e84b-4b38-8808-e7adceed2b36 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:03.348442 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-36dce513-e84b-4b38-8808-e7adceed2b36 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1358 microversion: 2.1 time: 0.156542 Jul 11 14:26:03.348946 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 520/1054] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:03 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:03.669221 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-f1eb926f-92e4-4263-bb4e-97bb5ef1868d req-39c3c59d-3e63-4be7-bbee-45a3e0302b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf4e883-131c-41d8-b271-1054ff03ef1b", "tag": "fa16bd48-7aab-4dfa-a0ec-9a48098f3a4e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:26:03.674116 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:03.675052 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:03.683317 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f1eb926f-92e4-4263-bb4e-97bb5ef1868d req-39c3c59d-3e63-4be7-bbee-45a3e0302b86 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:03.684140 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f1eb926f-92e4-4263-bb4e-97bb5ef1868d req-39c3c59d-3e63-4be7-bbee-45a3e0302b86 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:03.696627 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-f1eb926f-92e4-4263-bb4e-97bb5ef1868d req-39c3c59d-3e63-4be7-bbee-45a3e0302b86 service nova] Creating event network-changed:fa16bd48-7aab-4dfa-a0ec-9a48098f3a4e for instance baf4e883-131c-41d8-b271-1054ff03ef1b on hv-cinder-81914 Jul 11 14:26:03.701752 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-f1eb926f-92e4-4263-bb4e-97bb5ef1868d req-39c3c59d-3e63-4be7-bbee-45a3e0302b86 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036894 Jul 11 14:26:03.702418 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 535/1055] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:26:04.366549 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-34381c4c-a1b1-449e-9922-95e66127f229 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:04.367168 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-34381c4c-a1b1-449e-9922-95e66127f229 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:04.369029 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:04.374754 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34381c4c-a1b1-449e-9922-95e66127f229 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:04.375197 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34381c4c-a1b1-449e-9922-95e66127f229 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:04.375962 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34381c4c-a1b1-449e-9922-95e66127f229 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:04.376420 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34381c4c-a1b1-449e-9922-95e66127f229 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:04.512813 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-34381c4c-a1b1-449e-9922-95e66127f229 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:04.522298 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-34381c4c-a1b1-449e-9922-95e66127f229 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1358 microversion: 2.1 time: 0.160766 Jul 11 14:26:04.522815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 521/1056] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:04 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:05.543273 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-367c5f72-1013-4642-97a4-e9fb0b8da1ac tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:05.543273 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-367c5f72-1013-4642-97a4-e9fb0b8da1ac tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:05.549441 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-367c5f72-1013-4642-97a4-e9fb0b8da1ac tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:05.549441 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-367c5f72-1013-4642-97a4-e9fb0b8da1ac tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:05.549874 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-367c5f72-1013-4642-97a4-e9fb0b8da1ac tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:05.550450 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-367c5f72-1013-4642-97a4-e9fb0b8da1ac tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:05.725833 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-367c5f72-1013-4642-97a4-e9fb0b8da1ac tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:05.733475 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-367c5f72-1013-4642-97a4-e9fb0b8da1ac tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1358 microversion: 2.1 time: 0.197629 Jul 11 14:26:05.734056 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 536/1057] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:05 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:06.751191 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fa968d0e-b783-4300-a9e6-74277beb250d tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:06.751805 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fa968d0e-b783-4300-a9e6-74277beb250d tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:06.758906 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa968d0e-b783-4300-a9e6-74277beb250d tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:06.759354 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa968d0e-b783-4300-a9e6-74277beb250d tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:06.760108 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa968d0e-b783-4300-a9e6-74277beb250d tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:06.760539 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa968d0e-b783-4300-a9e6-74277beb250d tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:06.890962 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fa968d0e-b783-4300-a9e6-74277beb250d tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:06.899173 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fa968d0e-b783-4300-a9e6-74277beb250d tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1358 microversion: 2.1 time: 0.151860 Jul 11 14:26:06.899755 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 522/1058] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:06 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:07.244739 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-1ac5bda9-5236-4234-b468-31a961b3943b req-cb546d2a-f5b6-4490-93e5-d99dacbd3a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf4e883-131c-41d8-b271-1054ff03ef1b", "name": "network-vif-plugged", "status": "completed", "tag": "fa16bd48-7aab-4dfa-a0ec-9a48098f3a4e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:26:07.253871 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1ac5bda9-5236-4234-b468-31a961b3943b req-cb546d2a-f5b6-4490-93e5-d99dacbd3a0b service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:07.254528 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1ac5bda9-5236-4234-b468-31a961b3943b req-cb546d2a-f5b6-4490-93e5-d99dacbd3a0b service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:07.268071 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-1ac5bda9-5236-4234-b468-31a961b3943b req-cb546d2a-f5b6-4490-93e5-d99dacbd3a0b service nova] Creating event network-vif-plugged:fa16bd48-7aab-4dfa-a0ec-9a48098f3a4e for instance baf4e883-131c-41d8-b271-1054ff03ef1b on hv-cinder-81914 Jul 11 14:26:07.273907 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-1ac5bda9-5236-4234-b468-31a961b3943b req-cb546d2a-f5b6-4490-93e5-d99dacbd3a0b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033046 Jul 11 14:26:07.274544 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 537/1059] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:26:07.916530 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9556e71d-bef2-4ab6-a9ac-cbb042d78434 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:07.917146 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9556e71d-bef2-4ab6-a9ac-cbb042d78434 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:07.923760 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9556e71d-bef2-4ab6-a9ac-cbb042d78434 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:07.924210 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9556e71d-bef2-4ab6-a9ac-cbb042d78434 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:07.924978 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9556e71d-bef2-4ab6-a9ac-cbb042d78434 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:07.925415 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9556e71d-bef2-4ab6-a9ac-cbb042d78434 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:08.059386 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9556e71d-bef2-4ab6-a9ac-cbb042d78434 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:08.066826 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9556e71d-bef2-4ab6-a9ac-cbb042d78434 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1358 microversion: 2.1 time: 0.154619 Jul 11 14:26:08.067403 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 523/1060] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:07 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:09.084779 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4db25dce-95a7-4cfb-9b28-8a0e22946078 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:09.085565 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4db25dce-95a7-4cfb-9b28-8a0e22946078 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:09.093279 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4db25dce-95a7-4cfb-9b28-8a0e22946078 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:09.093747 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4db25dce-95a7-4cfb-9b28-8a0e22946078 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:09.094560 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4db25dce-95a7-4cfb-9b28-8a0e22946078 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:09.095002 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4db25dce-95a7-4cfb-9b28-8a0e22946078 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:09.237946 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4db25dce-95a7-4cfb-9b28-8a0e22946078 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:09.246632 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4db25dce-95a7-4cfb-9b28-8a0e22946078 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1548 microversion: 2.1 time: 0.166067 Jul 11 14:26:09.247219 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 538/1061] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:09 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:09.262693 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-53f62d58-3126-48a7-9f09-1ceed6c13518 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:09.263305 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-53f62d58-3126-48a7-9f09-1ceed6c13518 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:09.269767 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-53f62d58-3126-48a7-9f09-1ceed6c13518 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:09.270252 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-53f62d58-3126-48a7-9f09-1ceed6c13518 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:09.271016 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-53f62d58-3126-48a7-9f09-1ceed6c13518 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:09.271448 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-53f62d58-3126-48a7-9f09-1ceed6c13518 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:09.403132 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-53f62d58-3126-48a7-9f09-1ceed6c13518 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:09.410586 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-53f62d58-3126-48a7-9f09-1ceed6c13518 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1548 microversion: 2.1 time: 0.151681 Jul 11 14:26:09.411157 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 524/1062] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:09 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:09.426848 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a45b4b32-7d7a-49b6-8ff9-56075aeb7840 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:09.430500 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a45b4b32-7d7a-49b6-8ff9-56075aeb7840 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:09.431270 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a45b4b32-7d7a-49b6-8ff9-56075aeb7840 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Searching by: {'deleted': False, 'project_id': '47332445bab940c495cb7c4568c5c315'} {{(pid=117920) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 11 14:26:09.437991 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a45b4b32-7d7a-49b6-8ff9-56075aeb7840 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:09.438480 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a45b4b32-7d7a-49b6-8ff9-56075aeb7840 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:09.439278 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a45b4b32-7d7a-49b6-8ff9-56075aeb7840 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:09.439714 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a45b4b32-7d7a-49b6-8ff9-56075aeb7840 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:09.528205 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.multi_cell_list [None req-a45b4b32-7d7a-49b6-8ff9-56075aeb7840 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 11 14:26:09.647853 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a45b4b32-7d7a-49b6-8ff9-56075aeb7840 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.224156 Jul 11 14:26:09.648444 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 539/1063] 10.222.0.66 () {58 vars in 1124 bytes} [Mon Jul 11 14:26:09 2022] GET /compute/v2.1/servers => generated 342 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:26:09.658619 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2c5b9e72-0d3c-4633-a475-5161f1a3285b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:09.659232 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2c5b9e72-0d3c-4633-a475-5161f1a3285b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:09.666134 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2c5b9e72-0d3c-4633-a475-5161f1a3285b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:09.666612 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2c5b9e72-0d3c-4633-a475-5161f1a3285b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:09.667373 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2c5b9e72-0d3c-4633-a475-5161f1a3285b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:09.667808 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2c5b9e72-0d3c-4633-a475-5161f1a3285b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:09.796365 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2c5b9e72-0d3c-4633-a475-5161f1a3285b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:09.803932 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2c5b9e72-0d3c-4633-a475-5161f1a3285b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1548 microversion: 2.1 time: 0.149187 Jul 11 14:26:09.804508 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 525/1064] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:09 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:11.316232 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-460d1701-eaec-4a03-8c6b-ae7c8611d32b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f573f537-85f1-4821-87eb-2d3ceec64963"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:26:11.317292 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-460d1701-eaec-4a03-8c6b-ae7c8611d32b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:11.324464 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-460d1701-eaec-4a03-8c6b-ae7c8611d32b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:11.324912 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-460d1701-eaec-4a03-8c6b-ae7c8611d32b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:11.325671 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-460d1701-eaec-4a03-8c6b-ae7c8611d32b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:11.326104 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-460d1701-eaec-4a03-8c6b-ae7c8611d32b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:11.580334 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-460d1701-eaec-4a03-8c6b-ae7c8611d32b tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "POST /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267737 Jul 11 14:26:11.580987 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 540/1065] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 11 14:26:11 2022] POST /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:26:19.303668 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-693a1a80-a9bb-4d7b-b59d-4826583fe324 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:19.304361 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-693a1a80-a9bb-4d7b-b59d-4826583fe324 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:19.311317 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-693a1a80-a9bb-4d7b-b59d-4826583fe324 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:19.311765 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-693a1a80-a9bb-4d7b-b59d-4826583fe324 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:19.312523 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-693a1a80-a9bb-4d7b-b59d-4826583fe324 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:19.312967 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-693a1a80-a9bb-4d7b-b59d-4826583fe324 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:19.447024 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-693a1a80-a9bb-4d7b-b59d-4826583fe324 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:19.455049 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-693a1a80-a9bb-4d7b-b59d-4826583fe324 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1594 microversion: 2.1 time: 0.155261 Jul 11 14:26:19.455624 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 526/1066] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:19 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:21.507404 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:21.508904 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:21.572478 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:21.656013 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-1d54929a-b79c-4027-b191-a07fb1b7a513 req-119688d5-9cf6-478b-816c-5baa6ad721f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf4e883-131c-41d8-b271-1054ff03ef1b", "tag": "fa16bd48-7aab-4dfa-a0ec-9a48098f3a4e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:26:21.665637 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1d54929a-b79c-4027-b191-a07fb1b7a513 req-119688d5-9cf6-478b-816c-5baa6ad721f1 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:21.666145 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1d54929a-b79c-4027-b191-a07fb1b7a513 req-119688d5-9cf6-478b-816c-5baa6ad721f1 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:21.678013 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-1d54929a-b79c-4027-b191-a07fb1b7a513 req-119688d5-9cf6-478b-816c-5baa6ad721f1 service nova] Creating event network-changed:fa16bd48-7aab-4dfa-a0ec-9a48098f3a4e for instance baf4e883-131c-41d8-b271-1054ff03ef1b on hv-cinder-81914 Jul 11 14:26:21.684113 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-1d54929a-b79c-4027-b191-a07fb1b7a513 req-119688d5-9cf6-478b-816c-5baa6ad721f1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178023 Jul 11 14:26:21.685012 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 541/1067] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:26:22.684353 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a3835b83-811a-4b36-9529-2d756ba50cba tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1931988054"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:26:22.684978 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a3835b83-811a-4b36-9529-2d756ba50cba tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:22.687554 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:22.693433 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3835b83-811a-4b36-9529-2d756ba50cba tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:22.693872 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3835b83-811a-4b36-9529-2d756ba50cba tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:22.694620 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3835b83-811a-4b36-9529-2d756ba50cba tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:22.695018 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3835b83-811a-4b36-9529-2d756ba50cba tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:22.699996 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=61 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:22.830672 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.network.security_group_api [None req-a3835b83-811a-4b36-9529-2d756ba50cba tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Adding security group 0b5f0475-4403-4ac4-a8f8-08cc022238d3 to port fa16bd48-7aab-4dfa-a0ec-9a48098f3a4e Jul 11 14:26:23.181014 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a3835b83-811a-4b36-9529-2d756ba50cba tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "POST /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/action" status: 202 len: 0 microversion: 2.1 time: 0.501563 Jul 11 14:26:23.184699 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 527/1068] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 11 14:26:22 2022] POST /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:26:23.192456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aad1b352-76e4-4c92-ab00-cd1df42ad289 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:23.192456 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aad1b352-76e4-4c92-ab00-cd1df42ad289 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:23.201217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aad1b352-76e4-4c92-ab00-cd1df42ad289 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:23.201217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aad1b352-76e4-4c92-ab00-cd1df42ad289 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:23.201217 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aad1b352-76e4-4c92-ab00-cd1df42ad289 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:23.201650 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aad1b352-76e4-4c92-ab00-cd1df42ad289 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:23.365940 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aad1b352-76e4-4c92-ab00-cd1df42ad289 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:23.377685 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aad1b352-76e4-4c92-ab00-cd1df42ad289 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1760 microversion: 2.1 time: 0.191258 Jul 11 14:26:23.378822 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 542/1069] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:23 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1760 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:23.699493 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-a49ae8af-ba06-4277-9233-f09365290468 req-31ace3bd-6982-40eb-93b6-f4720620135d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf4e883-131c-41d8-b271-1054ff03ef1b", "tag": "fa16bd48-7aab-4dfa-a0ec-9a48098f3a4e"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:26:23.708271 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-a49ae8af-ba06-4277-9233-f09365290468 req-31ace3bd-6982-40eb-93b6-f4720620135d service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:23.708721 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-a49ae8af-ba06-4277-9233-f09365290468 req-31ace3bd-6982-40eb-93b6-f4720620135d service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:23.721883 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-a49ae8af-ba06-4277-9233-f09365290468 req-31ace3bd-6982-40eb-93b6-f4720620135d service nova] Creating event network-changed:fa16bd48-7aab-4dfa-a0ec-9a48098f3a4e for instance baf4e883-131c-41d8-b271-1054ff03ef1b on hv-cinder-81914 Jul 11 14:26:23.727897 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-a49ae8af-ba06-4277-9233-f09365290468 req-31ace3bd-6982-40eb-93b6-f4720620135d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032175 Jul 11 14:26:23.728527 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 528/1070] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:26:46.945140 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:26:46.945880 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Mon Jul 11 14:26:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:26:46.986995 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-545751c1-7c72-4f40-bed9-db0748922236 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:26:46.987939 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-545751c1-7c72-4f40-bed9-db0748922236 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:46.990943 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:46.991602 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=8 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:46.998323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-545751c1-7c72-4f40-bed9-db0748922236 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:46.998798 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-545751c1-7c72-4f40-bed9-db0748922236 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:46.999671 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-545751c1-7c72-4f40-bed9-db0748922236 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:46.999989 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-545751c1-7c72-4f40-bed9-db0748922236 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:47.076751 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-545751c1-7c72-4f40-bed9-db0748922236 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "POST /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/action" status: 202 len: 0 microversion: 2.1 time: 0.093457 Jul 11 14:26:47.077593 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 543/1071] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 11 14:26:46 2022] POST /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:26:47.083513 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:47.084261 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=5 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:47.088695 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a5bcc46f-a156-4ee8-8dd1-6ff84c51cd51 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:47.089401 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a5bcc46f-a156-4ee8-8dd1-6ff84c51cd51 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:47.097152 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a5bcc46f-a156-4ee8-8dd1-6ff84c51cd51 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:47.097601 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a5bcc46f-a156-4ee8-8dd1-6ff84c51cd51 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:47.098400 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a5bcc46f-a156-4ee8-8dd1-6ff84c51cd51 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:47.098834 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a5bcc46f-a156-4ee8-8dd1-6ff84c51cd51 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:47.251115 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a5bcc46f-a156-4ee8-8dd1-6ff84c51cd51 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:47.259117 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a5bcc46f-a156-4ee8-8dd1-6ff84c51cd51 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1752 microversion: 2.1 time: 0.177011 Jul 11 14:26:47.259854 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 529/1072] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:47 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:48.276924 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2647f88a-ba8b-4523-9db9-4ebba651ce02 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:48.277633 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2647f88a-ba8b-4523-9db9-4ebba651ce02 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:48.284414 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2647f88a-ba8b-4523-9db9-4ebba651ce02 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:48.284979 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2647f88a-ba8b-4523-9db9-4ebba651ce02 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:48.285756 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2647f88a-ba8b-4523-9db9-4ebba651ce02 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:48.286872 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2647f88a-ba8b-4523-9db9-4ebba651ce02 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:48.435865 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2647f88a-ba8b-4523-9db9-4ebba651ce02 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:48.443822 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2647f88a-ba8b-4523-9db9-4ebba651ce02 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1757 microversion: 2.1 time: 0.171127 Jul 11 14:26:48.444401 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 544/1073] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:48 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:49.463416 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e0586e5f-dcf7-4222-a64c-d21c0add7657 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:49.464016 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e0586e5f-dcf7-4222-a64c-d21c0add7657 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:49.470545 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e0586e5f-dcf7-4222-a64c-d21c0add7657 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:49.470927 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e0586e5f-dcf7-4222-a64c-d21c0add7657 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:49.471682 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e0586e5f-dcf7-4222-a64c-d21c0add7657 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:49.472109 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e0586e5f-dcf7-4222-a64c-d21c0add7657 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:49.613761 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e0586e5f-dcf7-4222-a64c-d21c0add7657 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:49.621889 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e0586e5f-dcf7-4222-a64c-d21c0add7657 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1757 microversion: 2.1 time: 0.162987 Jul 11 14:26:49.622503 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 530/1074] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:49 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:50.639746 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-68cb5d67-b7f1-4d8e-a06e-276dec4599f5 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:50.640365 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-68cb5d67-b7f1-4d8e-a06e-276dec4599f5 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:50.648021 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68cb5d67-b7f1-4d8e-a06e-276dec4599f5 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:50.648472 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68cb5d67-b7f1-4d8e-a06e-276dec4599f5 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:50.649250 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68cb5d67-b7f1-4d8e-a06e-276dec4599f5 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:50.649715 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68cb5d67-b7f1-4d8e-a06e-276dec4599f5 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:50.796714 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-68cb5d67-b7f1-4d8e-a06e-276dec4599f5 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:50.804634 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-68cb5d67-b7f1-4d8e-a06e-276dec4599f5 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1757 microversion: 2.1 time: 0.168812 Jul 11 14:26:50.805203 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 545/1075] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:50 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:51.823074 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-89d1aeaa-f64d-4d58-bfa5-890fb9196859 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:51.823707 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-89d1aeaa-f64d-4d58-bfa5-890fb9196859 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:51.830246 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-89d1aeaa-f64d-4d58-bfa5-890fb9196859 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:51.830736 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-89d1aeaa-f64d-4d58-bfa5-890fb9196859 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:51.831503 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-89d1aeaa-f64d-4d58-bfa5-890fb9196859 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:51.831934 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-89d1aeaa-f64d-4d58-bfa5-890fb9196859 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:51.982705 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-89d1aeaa-f64d-4d58-bfa5-890fb9196859 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:51.990931 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-89d1aeaa-f64d-4d58-bfa5-890fb9196859 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1757 microversion: 2.1 time: 0.172424 Jul 11 14:26:51.991501 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 531/1076] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:51 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:53.009089 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-575699f7-4402-4d0f-935b-0bd35b0c58cd tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:53.009688 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-575699f7-4402-4d0f-935b-0bd35b0c58cd tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:53.016954 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-575699f7-4402-4d0f-935b-0bd35b0c58cd tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:53.017407 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-575699f7-4402-4d0f-935b-0bd35b0c58cd tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:53.018208 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-575699f7-4402-4d0f-935b-0bd35b0c58cd tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:53.018675 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-575699f7-4402-4d0f-935b-0bd35b0c58cd tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:53.414741 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-575699f7-4402-4d0f-935b-0bd35b0c58cd tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:53.422860 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-575699f7-4402-4d0f-935b-0bd35b0c58cd tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1757 microversion: 2.1 time: 0.417892 Jul 11 14:26:53.423439 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 546/1077] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:53 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1757 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:54.439730 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-eca8982d-dcd0-4e84-a697-e16e4dc94f77 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:54.440281 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-eca8982d-dcd0-4e84-a697-e16e4dc94f77 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:54.446735 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eca8982d-dcd0-4e84-a697-e16e4dc94f77 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:54.447194 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eca8982d-dcd0-4e84-a697-e16e4dc94f77 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:54.448114 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eca8982d-dcd0-4e84-a697-e16e4dc94f77 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:54.448555 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eca8982d-dcd0-4e84-a697-e16e4dc94f77 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:54.597752 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-eca8982d-dcd0-4e84-a697-e16e4dc94f77 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:54.605775 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-eca8982d-dcd0-4e84-a697-e16e4dc94f77 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1757 microversion: 2.1 time: 0.169932 Jul 11 14:26:54.606366 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 532/1078] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:54 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:55.624721 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5d2274a8-b6b6-42ab-9642-8bc0cae83cd4 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:55.625268 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5d2274a8-b6b6-42ab-9642-8bc0cae83cd4 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:55.631385 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d2274a8-b6b6-42ab-9642-8bc0cae83cd4 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:55.631831 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d2274a8-b6b6-42ab-9642-8bc0cae83cd4 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:55.632593 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d2274a8-b6b6-42ab-9642-8bc0cae83cd4 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:55.633023 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d2274a8-b6b6-42ab-9642-8bc0cae83cd4 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:55.776508 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5d2274a8-b6b6-42ab-9642-8bc0cae83cd4 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:55.784657 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5d2274a8-b6b6-42ab-9642-8bc0cae83cd4 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1757 microversion: 2.1 time: 0.165183 Jul 11 14:26:55.785236 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 547/1079] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:55 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:56.802675 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c7beb913-e9ae-4f67-9990-81902d7a29cf tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:56.803291 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c7beb913-e9ae-4f67-9990-81902d7a29cf tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:56.810753 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7beb913-e9ae-4f67-9990-81902d7a29cf tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:56.811203 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7beb913-e9ae-4f67-9990-81902d7a29cf tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:56.811994 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7beb913-e9ae-4f67-9990-81902d7a29cf tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:56.812574 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7beb913-e9ae-4f67-9990-81902d7a29cf tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:56.966957 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c7beb913-e9ae-4f67-9990-81902d7a29cf tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:56.975144 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c7beb913-e9ae-4f67-9990-81902d7a29cf tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1757 microversion: 2.1 time: 0.176367 Jul 11 14:26:56.975720 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 533/1080] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:56 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:57.993034 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-501e5f39-b348-49ff-8e16-46770bf1bb70 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:57.993643 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-501e5f39-b348-49ff-8e16-46770bf1bb70 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:58.001119 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-501e5f39-b348-49ff-8e16-46770bf1bb70 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:58.001568 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-501e5f39-b348-49ff-8e16-46770bf1bb70 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:58.002370 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-501e5f39-b348-49ff-8e16-46770bf1bb70 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:58.003304 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-501e5f39-b348-49ff-8e16-46770bf1bb70 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:58.148559 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-501e5f39-b348-49ff-8e16-46770bf1bb70 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:58.157219 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-501e5f39-b348-49ff-8e16-46770bf1bb70 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1757 microversion: 2.1 time: 0.168035 Jul 11 14:26:58.157803 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 548/1081] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:57 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:59.175490 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7915c3fb-f292-412e-855c-e2f965ea2f33 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:26:59.176107 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7915c3fb-f292-412e-855c-e2f965ea2f33 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:26:59.184054 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7915c3fb-f292-412e-855c-e2f965ea2f33 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:59.184505 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7915c3fb-f292-412e-855c-e2f965ea2f33 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:59.185283 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7915c3fb-f292-412e-855c-e2f965ea2f33 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:26:59.185719 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7915c3fb-f292-412e-855c-e2f965ea2f33 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:26:59.330809 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7915c3fb-f292-412e-855c-e2f965ea2f33 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:26:59.338818 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7915c3fb-f292-412e-855c-e2f965ea2f33 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1760 microversion: 2.1 time: 0.167215 Jul 11 14:26:59.339392 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 534/1082] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:26:59 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:27:34.467401 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-64b37701-e80e-4c1a-9b34-c827242b9af5 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1931988054"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:27:34.468006 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-64b37701-e80e-4c1a-9b34-c827242b9af5 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:27:34.470142 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=12 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:34.470824 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:34.477245 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64b37701-e80e-4c1a-9b34-c827242b9af5 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:34.477699 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64b37701-e80e-4c1a-9b34-c827242b9af5 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:34.478509 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64b37701-e80e-4c1a-9b34-c827242b9af5 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:34.478951 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64b37701-e80e-4c1a-9b34-c827242b9af5 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:34.614592 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.network.security_group_api [None req-64b37701-e80e-4c1a-9b34-c827242b9af5 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Removing security group 0b5f0475-4403-4ac4-a8f8-08cc022238d3 from port fa16bd48-7aab-4dfa-a0ec-9a48098f3a4e Jul 11 14:27:34.963612 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-64b37701-e80e-4c1a-9b34-c827242b9af5 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "POST /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/action" status: 202 len: 0 microversion: 2.1 time: 0.501509 Jul 11 14:27:34.964926 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 549/1083] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 11 14:27:34 2022] POST /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:27:34.981672 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-35b6a927-9e71-431d-874d-2deb1f4bbd85 req-eb24cc37-2c5e-496c-b2c7-363834e49e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf4e883-131c-41d8-b271-1054ff03ef1b", "tag": "fa16bd48-7aab-4dfa-a0ec-9a48098f3a4e"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:27:34.985436 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=12 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:34.986097 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=36 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:34.992387 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-35b6a927-9e71-431d-874d-2deb1f4bbd85 req-eb24cc37-2c5e-496c-b2c7-363834e49e50 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:34.992835 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-35b6a927-9e71-431d-874d-2deb1f4bbd85 req-eb24cc37-2c5e-496c-b2c7-363834e49e50 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:35.005473 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-35b6a927-9e71-431d-874d-2deb1f4bbd85 req-eb24cc37-2c5e-496c-b2c7-363834e49e50 service nova] Creating event network-changed:fa16bd48-7aab-4dfa-a0ec-9a48098f3a4e for instance baf4e883-131c-41d8-b271-1054ff03ef1b on hv-cinder-81914 Jul 11 14:27:35.020007 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-35b6a927-9e71-431d-874d-2deb1f4bbd85 req-eb24cc37-2c5e-496c-b2c7-363834e49e50 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048653 Jul 11 14:27:35.021323 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 535/1084] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:27:36.107066 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0c6afea1-48cb-452e-8deb-e08aa998b30e tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:27:36.107618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0c6afea1-48cb-452e-8deb-e08aa998b30e tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:27:36.112762 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-d6bea866-28b8-4f39-add8-94a41aabb34e req-eb0a3a42-9667-4949-8d54-31118fa7ba4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf4e883-131c-41d8-b271-1054ff03ef1b", "tag": "fa16bd48-7aab-4dfa-a0ec-9a48098f3a4e"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:27:36.115079 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c6afea1-48cb-452e-8deb-e08aa998b30e tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:36.115540 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c6afea1-48cb-452e-8deb-e08aa998b30e tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:36.116326 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c6afea1-48cb-452e-8deb-e08aa998b30e tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:36.116767 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c6afea1-48cb-452e-8deb-e08aa998b30e tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:36.122889 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-d6bea866-28b8-4f39-add8-94a41aabb34e req-eb0a3a42-9667-4949-8d54-31118fa7ba4f service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:36.123855 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-d6bea866-28b8-4f39-add8-94a41aabb34e req-eb0a3a42-9667-4949-8d54-31118fa7ba4f service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:36.136060 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-d6bea866-28b8-4f39-add8-94a41aabb34e req-eb0a3a42-9667-4949-8d54-31118fa7ba4f service nova] Creating event network-changed:fa16bd48-7aab-4dfa-a0ec-9a48098f3a4e for instance baf4e883-131c-41d8-b271-1054ff03ef1b on hv-cinder-81914 Jul 11 14:27:36.141166 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-d6bea866-28b8-4f39-add8-94a41aabb34e req-eb0a3a42-9667-4949-8d54-31118fa7ba4f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034156 Jul 11 14:27:36.141777 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 536/1085] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:27:36.204487 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-0c6afea1-48cb-452e-8deb-e08aa998b30e tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lazy-loading 'services' on Instance uuid baf4e883-131c-41d8-b271-1054ff03ef1b {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:27:36.284063 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0c6afea1-48cb-452e-8deb-e08aa998b30e tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "DELETE /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/os-volume_attachments/f573f537-85f1-4821-87eb-2d3ceec64963" status: 202 len: 0 microversion: 2.1 time: 0.182338 Jul 11 14:27:36.285344 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 550/1086] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 11 14:27:36 2022] DELETE /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/os-volume_attachments/f573f537-85f1-4821-87eb-2d3ceec64963 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:27:36.296045 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-aca46339-0d98-45fd-8376-568c2297bb17 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:27:36.297232 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-aca46339-0d98-45fd-8376-568c2297bb17 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:27:36.303987 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aca46339-0d98-45fd-8376-568c2297bb17 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:36.304570 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aca46339-0d98-45fd-8376-568c2297bb17 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:36.305788 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aca46339-0d98-45fd-8376-568c2297bb17 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:36.306420 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aca46339-0d98-45fd-8376-568c2297bb17 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:36.341419 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-aca46339-0d98-45fd-8376-568c2297bb17 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051545 Jul 11 14:27:36.342229 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 537/1087] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:27:36 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:27:37.353526 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-20c51e20-26d3-42c3-a81a-d2723b428d13 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:27:37.354721 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-20c51e20-26d3-42c3-a81a-d2723b428d13 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:27:37.361522 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-20c51e20-26d3-42c3-a81a-d2723b428d13 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:37.361965 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-20c51e20-26d3-42c3-a81a-d2723b428d13 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:37.363009 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-20c51e20-26d3-42c3-a81a-d2723b428d13 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:37.363442 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-20c51e20-26d3-42c3-a81a-d2723b428d13 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:37.396445 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-20c51e20-26d3-42c3-a81a-d2723b428d13 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047154 Jul 11 14:27:37.397053 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 551/1088] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:27:37 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:27:38.408384 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e698825a-fbae-4cd9-aa5b-c7ee15e32d59 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:27:38.409305 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e698825a-fbae-4cd9-aa5b-c7ee15e32d59 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:27:38.415819 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e698825a-fbae-4cd9-aa5b-c7ee15e32d59 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:38.416267 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e698825a-fbae-4cd9-aa5b-c7ee15e32d59 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:38.417061 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e698825a-fbae-4cd9-aa5b-c7ee15e32d59 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:38.417534 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e698825a-fbae-4cd9-aa5b-c7ee15e32d59 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:38.445815 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e698825a-fbae-4cd9-aa5b-c7ee15e32d59 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041405 Jul 11 14:27:38.446428 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 538/1089] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 11 14:27:38 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 14:27:38.457323 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3d4b576b-bca0-4de6-b5e1-ea0548709700 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:27:38.457903 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3d4b576b-bca0-4de6-b5e1-ea0548709700 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:27:38.465763 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d4b576b-bca0-4de6-b5e1-ea0548709700 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:38.466148 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d4b576b-bca0-4de6-b5e1-ea0548709700 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:38.467294 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d4b576b-bca0-4de6-b5e1-ea0548709700 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:38.467997 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d4b576b-bca0-4de6-b5e1-ea0548709700 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:38.557037 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-3d4b576b-bca0-4de6-b5e1-ea0548709700 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] HTTP exception thrown: Instance baf4e883-131c-41d8-b271-1054ff03ef1b is not attached to volume f573f537-85f1-4821-87eb-2d3ceec64963 Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3d4b576b-bca0-4de6-b5e1-ea0548709700 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Request method failure captured: Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/os-volume_attachments/f573f537-85f1-4821-87eb-2d3ceec64963 HTTP/1.1 Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDLgir0rA0m_I1MR1IvUdfObNsb-scZ6UGwdBwY3D6kSGp1utPmSc463xeZ2bCZ1yAvGD6JaFB6AZLDLmMJQgFZUKB0SCbCBnBL1nXiU1NPF8fhzGXgikVef90QPUHpKMTekIceXWOWftiRoH2MGaLaST5TIXM_Al0QtFEly0Oa7-ic Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 47332445bab940c495cb7c4568c5c315 Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestMinimumBasicScenario-1311966196 Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:27:38.560093 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:27:38.561895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_47332445bab940c495cb7c4568c5c315"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/47332445bab940c495cb7c4568c5c315"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/47332445bab940c495cb7c4568c5c315"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/47332445bab940c495cb7c4568c5c315"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:27:38.561895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestMinimumBasicScenario-1311966196 Jul 11 14:27:38.561895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 47332445bab940c495cb7c4568c5c315 Jul 11 14:27:38.561895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1311966196 Jul 11 14:27:38.561895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-TestMinimumBasicScenario-1311966196-project Jul 11 14:27:38.561895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:27:38.561895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:27:38.561895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 8423598c60644919af82bd0280c0c734 Jul 11 14:27:38.561895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestMinimumBasicScenario-1311966196-project Jul 11 14:27:38.561895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:27:38.561895 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance baf4e883-131c-41d8-b271-1054ff03ef1b is not attached to volume f573f537-85f1-4821-87eb-2d3ceec64963 Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'server_id': 'baf4e883-131c-41d8-b271-1054ff03ef1b', 'id': 'f573f537-85f1-4821-87eb-2d3ceec64963'} Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f573f537-85f1-4821-87eb-2d3ceec64963. Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:27:38.563095 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:27:38.564820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:27:38.564820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 11 14:27:38.564820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 11 14:27:38.564820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baf4e883-131c-41d8-b271-1054ff03ef1b is not attached to volume f573f537-85f1-4821-87eb-2d3ceec64963 Jul 11 14:27:38.564820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:27:38.564820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:27:38.564820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:27:38.564820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:27:38.564820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:27:38.564820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:27:38.564820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:27:38.564820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:27:38.564820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baf4e883-131c-41d8-b271-1054ff03ef1b is not attached to volume f573f537-85f1-4821-87eb-2d3ceec64963 Jul 11 14:27:38.564820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:27:38.564820 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3d4b576b-bca0-4de6-b5e1-ea0548709700 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Returning 404 to user: Instance baf4e883-131c-41d8-b271-1054ff03ef1b is not attached to volume f573f537-85f1-4821-87eb-2d3ceec64963 {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:27:38.566112 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3d4b576b-bca0-4de6-b5e1-ea0548709700 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "DELETE /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/os-volume_attachments/f573f537-85f1-4821-87eb-2d3ceec64963" status: 404 len: 154 microversion: 2.1 time: 0.108530 Jul 11 14:27:38.566112 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 552/1090] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 11 14:27:38 2022] DELETE /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b/os-volume_attachments/f573f537-85f1-4821-87eb-2d3ceec64963 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:27:39.696740 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3409cf3e-52ef-48ba-beee-89530e920e3c tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:27:39.697259 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3409cf3e-52ef-48ba-beee-89530e920e3c tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:27:39.704003 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3409cf3e-52ef-48ba-beee-89530e920e3c tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:39.704478 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3409cf3e-52ef-48ba-beee-89530e920e3c tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:39.705249 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3409cf3e-52ef-48ba-beee-89530e920e3c tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:39.705684 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3409cf3e-52ef-48ba-beee-89530e920e3c tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:39.730223 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3409cf3e-52ef-48ba-beee-89530e920e3c tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:27:39.805057 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3409cf3e-52ef-48ba-beee-89530e920e3c tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "DELETE /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 204 len: 0 microversion: 2.1 time: 0.111941 Jul 11 14:27:39.805661 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 539/1091] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 11 14:27:39 2022] DELETE /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:27:39.815146 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e875a69b-6556-409f-bd2d-7a2ca5fa84eb tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:27:39.815776 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e875a69b-6556-409f-bd2d-7a2ca5fa84eb tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:27:39.822253 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e875a69b-6556-409f-bd2d-7a2ca5fa84eb tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:39.822705 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e875a69b-6556-409f-bd2d-7a2ca5fa84eb tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:39.823749 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e875a69b-6556-409f-bd2d-7a2ca5fa84eb tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:39.824235 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e875a69b-6556-409f-bd2d-7a2ca5fa84eb tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:39.968687 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e875a69b-6556-409f-bd2d-7a2ca5fa84eb tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:27:39.976369 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e875a69b-6556-409f-bd2d-7a2ca5fa84eb tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1554 microversion: 2.1 time: 0.165592 Jul 11 14:27:39.976934 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 553/1092] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:27:39 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:27:40.996631 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fd541604-92e4-4830-892d-453615ae9973 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:27:40.997378 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fd541604-92e4-4830-892d-453615ae9973 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:27:41.003909 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fd541604-92e4-4830-892d-453615ae9973 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:41.004354 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fd541604-92e4-4830-892d-453615ae9973 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:41.005123 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fd541604-92e4-4830-892d-453615ae9973 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:41.005838 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fd541604-92e4-4830-892d-453615ae9973 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:41.140501 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fd541604-92e4-4830-892d-453615ae9973 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:27:41.148089 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fd541604-92e4-4830-892d-453615ae9973 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1554 microversion: 2.1 time: 0.156467 Jul 11 14:27:41.148659 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 540/1093] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:27:40 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:27:42.164964 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1cc726fe-b9a8-4bd6-8a25-443c0ade2668 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:27:42.165579 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1cc726fe-b9a8-4bd6-8a25-443c0ade2668 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:27:42.172375 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cc726fe-b9a8-4bd6-8a25-443c0ade2668 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:42.172817 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cc726fe-b9a8-4bd6-8a25-443c0ade2668 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:42.173586 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cc726fe-b9a8-4bd6-8a25-443c0ade2668 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:42.174015 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cc726fe-b9a8-4bd6-8a25-443c0ade2668 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:42.359026 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1cc726fe-b9a8-4bd6-8a25-443c0ade2668 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8423598c60644919af82bd0280c0c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47332445bab940c495cb7c4568c5c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:27:42.367807 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1cc726fe-b9a8-4bd6-8a25-443c0ade2668 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 200 len: 1554 microversion: 2.1 time: 0.206674 Jul 11 14:27:42.368397 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 554/1094] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:27:42 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 1554 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:27:42.504845 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-852f51a7-d72c-458d-8081-34280a779bea req-614d1c8d-7897-4a00-a3d3-6fa0f2aaa9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf4e883-131c-41d8-b271-1054ff03ef1b", "name": "network-vif-deleted", "tag": "fa16bd48-7aab-4dfa-a0ec-9a48098f3a4e"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:27:42.515338 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-852f51a7-d72c-458d-8081-34280a779bea req-614d1c8d-7897-4a00-a3d3-6fa0f2aaa9c3 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:42.515788 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-852f51a7-d72c-458d-8081-34280a779bea req-614d1c8d-7897-4a00-a3d3-6fa0f2aaa9c3 service nova] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:42.527671 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-852f51a7-d72c-458d-8081-34280a779bea req-614d1c8d-7897-4a00-a3d3-6fa0f2aaa9c3 service nova] Creating event network-vif-deleted:fa16bd48-7aab-4dfa-a0ec-9a48098f3a4e for instance baf4e883-131c-41d8-b271-1054ff03ef1b on hv-cinder-81914 Jul 11 14:27:42.532648 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-852f51a7-d72c-458d-8081-34280a779bea req-614d1c8d-7897-4a00-a3d3-6fa0f2aaa9c3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031594 Jul 11 14:27:42.533252 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 541/1095] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 11 14:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:27:43.386356 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0e610630-7f88-4188-85aa-9ff27c7e488a tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:27:43.386979 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0e610630-7f88-4188-85aa-9ff27c7e488a tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] [instance: baf4e883-131c-41d8-b271-1054ff03ef1b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:27:43.393453 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e610630-7f88-4188-85aa-9ff27c7e488a tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:43.393897 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e610630-7f88-4188-85aa-9ff27c7e488a tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:43.394692 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e610630-7f88-4188-85aa-9ff27c7e488a tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:27:43.395125 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e610630-7f88-4188-85aa-9ff27c7e488a tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Lock "b9ce20a7-cf1f-45a0-823d-be4011508976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:27:43.409055 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-0e610630-7f88-4188-85aa-9ff27c7e488a tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] HTTP exception thrown: Instance baf4e883-131c-41d8-b271-1054ff03ef1b could not be found. Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0e610630-7f88-4188-85aa-9ff27c7e488a tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Request method failure captured: Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b HTTP/1.1 Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Connection: close Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABizDLgir0rA0m_I1MR1IvUdfObNsb-scZ6UGwdBwY3D6kSGp1utPmSc463xeZ2bCZ1yAvGD6JaFB6AZLDLmMJQgFZUKB0SCbCBnBL1nXiU1NPF8fhzGXgikVef90QPUHpKMTekIceXWOWftiRoH2MGaLaST5TIXM_Al0QtFEly0Oa7-ic Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Id: 47332445bab940c495cb7c4568c5c315 Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestMinimumBasicScenario-1311966196 Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jul 11 14:27:43.410618 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jul 11 14:27:43.412387 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_47332445bab940c495cb7c4568c5c315"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/47332445bab940c495cb7c4568c5c315"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/47332445bab940c495cb7c4568c5c315"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/47332445bab940c495cb7c4568c5c315"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] Jul 11 14:27:43.412387 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestMinimumBasicScenario-1311966196 Jul 11 14:27:43.412387 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 47332445bab940c495cb7c4568c5c315 Jul 11 14:27:43.412387 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1311966196 Jul 11 14:27:43.412387 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User: tempest-TestMinimumBasicScenario-1311966196-project Jul 11 14:27:43.412387 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 11 14:27:43.412387 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 11 14:27:43.412387 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Id: 8423598c60644919af82bd0280c0c734 Jul 11 14:27:43.412387 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestMinimumBasicScenario-1311966196-project Jul 11 14:27:43.412387 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: method: > Jul 11 14:27:43.412387 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: exception: Instance baf4e883-131c-41d8-b271-1054ff03ef1b could not be found. Jul 11 14:27:43.412387 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: action_args: {'id': 'baf4e883-131c-41d8-b271-1054ff03ef1b'} Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baf4e883-131c-41d8-b271-1054ff03ef1b could not be found. Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:27:43.413289 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:27:43.415111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:27:43.415111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:27:43.415111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:27:43.415111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:27:43.415111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:27:43.415111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:27:43.415111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:27:43.415111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baf4e883-131c-41d8-b271-1054ff03ef1b could not be found. Jul 11 14:27:43.415111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:27:43.415111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:27:43.415111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:27:43.415111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:27:43.415111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:27:43.415111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:27:43.415111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:27:43.415111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:27:43.415111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baf4e883-131c-41d8-b271-1054ff03ef1b could not be found. Jul 11 14:27:43.415111 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 11 14:27:43.416912 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0e610630-7f88-4188-85aa-9ff27c7e488a tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Returning 404 to user: Instance baf4e883-131c-41d8-b271-1054ff03ef1b could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:27:43.416912 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0e610630-7f88-4188-85aa-9ff27c7e488a tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b" status: 404 len: 111 microversion: 2.1 time: 0.030465 Jul 11 14:27:43.416912 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 555/1096] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 11 14:27:43 2022] GET /compute/v2.1/servers/baf4e883-131c-41d8-b271-1054ff03ef1b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:27:43.421863 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a41f2df5-21fe-4381-9f67-ad9389ddae31 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] Calling method '.version_select at 0x7fc976c06ee0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:27:43.439128 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a41f2df5-21fe-4381-9f67-ad9389ddae31 tempest-TestMinimumBasicScenario-1311966196 tempest-TestMinimumBasicScenario-1311966196-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1652678082" status: 202 len: 0 microversion: 2.1 time: 0.021398 Jul 11 14:27:43.439699 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 542/1097] 10.222.0.66 () {58 vars in 1271 bytes} [Mon Jul 11 14:27:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1652678082 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:28:33.299682 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:28:33.300256 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Mon Jul 11 14:28:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:30:06.955166 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:30:06.955902 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Mon Jul 11 14:30:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:30:28.168981 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:30:28.169572 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Mon Jul 11 14:30:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:30:35.061669 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:30:35.062380 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Mon Jul 11 14:30:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:30:38.412891 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:30:38.413496 dv-cinder-819149-10-iscsi devstack@n-api.service[117921]: Mon Jul 11 14:30:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:31:53.307719 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:31:53.308429 dv-cinder-819149-10-iscsi devstack@n-api.service[117920]: Mon Jul 11 14:31:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!